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AN ATTEMPT 

• TO RESTRUCTURE 

• ELEMENTARY SCHOOLING 



Desire for change or improvement is natural. All of us 
arc motivated, expected, or even pressured to change our 
ideas, attitudes, and behaviors. Thus, teachers read journ- 
als, go to workshops, and attend professional meetings with 
the expectation of gleaning an idea or a tactic they might use 
to improve instruction. Administrators and educational schol- 
ars do the same things; ana they organize committees and 
tasl< forces, write essays, develop materials, and carry out 
research with the objective of improving the practice of 
schooling. Also, parents, special interest groups, and other 
social forces expect the schools to change to meet their 
demands. But what happens when resources are actually 
provided and literally thousands of scholars and practitioners 
are involved in a planned attempt to produce more effective 
elementary schools? This book answers that question for the 
particular case of Individually Guided Education (ICE). 

In chapter 1, an attempt has been made tc place ICE 
within the context of school reform efforts of the past quarter 
century. From that presentation, the assumed need for a 
change in elementary schooling and the assumptions upon 
which ICE was based should be apparent. In chapter 2, the 
intentions of the ICE program are outlined. Included is a 
brief discussion of the ideas that evolved and were later 
implemented in some 3,000 schools. The purpose of chapter 3 
is to describe the perspectives and procedures that we 
adopted to evaluate the ICE program* 
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CHAITER 1 



EFFECTIVE ELEMENTARY SCHOOLING 



Mention of the word school, particularly elementary 
school, often generates a set of images including red brick 
buildings; matronly teachers; freshly scrubbed, smiling 
children; well-worn books in some disarray in desks; dusty 
blackboards; and boisterous recesses. The images we all 
have could go on and on. They are a product our upbring- 
ing. Schools in other sections of this country and even in 
other countries seem familiar because most of the same images 
are prevalent. The physical surroundings may differ, but 
children and teachers and books remain and there is a facility 
called a school. In today's world, elementary schools exist 
and at least at a surface level share many common characteris- 
tics across cultures and settings. 

This phenomenon of elementary schooling so familiar to 
us all, however, is historically recent. Only in the last two 
centuries have societies seen fit to educate most of their 
children in schools. Every society educates its young, but 
for most of history, children received their education through 
the family, the community, and the church. Much education— the 
shaping of children's attitudes, behavior, and skills—is still 
carried on this way today. Schools for educating all children 
were created in large part to transmit some pre-established 
knowledge and skills to the young and to enculturate them 
more quickly and systematically into the prevailing social 
system. 

In the short time since their creation, elementary schools 
have evolved several primary characteristics. By far the 
most important features of schools are these; 

1. Schooling is goc directed. 

Educators are never free from questions or problems 
related to the aims of education. Most societies view school- 
ing as a vehicle for reaching some worthwhile destination or 
an instrument for shaping some desirable end product. 

2, Schooling is a collective experience. 

F-or tfie child, being in school means being in a crowd. 
For the teacher it means being responsible for a group of 
students. How a small number of adults can organize and 
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manage a large number of children is the central -organiza- 
tional problem of schools. This problem leads to the third 
primary feature of schools, 

3. Time is the major control mechanism of schools. 
School is a place where things often happen not because 
students want them to, but because it is time for them to 
occur (Jackson, 1968). Scheduling classes, allocating fixed 
times, and making sure teachers and students adhere to them 
is a large part of the role of school administrators. 

4. Students at a particular age are assumed to be more 
similar to each other than they are different. 

Children are basically grouped by age (all 6-year-olds 
are in the first grade). Although there is much rhetoric 
about attending to the individual needs and desires of each 
child, the actual groupings of children rarely reflect those 
concerns. In a typical elementary school, all children of an 
age are subdivided into sets containing 20 to 30 members and 
assigned to a teacher for a full school year— the self- 
contained, age-gradeci classroom. Also, within general content 
constraints involving grade level expectations in schools, each 
teacher is given considerable latitude in arranging the sche-- 
dule. 

5. Instruction within a time segment involves children worl<- 
ing on a lesson which stresses competition, order, and 
control. 

Regardless of ^he ingredients of a lesson, the dominant 
pedagogy in American schools involves intragroup competition. 
Competition is fostered because it is both a method of motivat- 
ing learning and a means of differentiating students. Accomp- 
lishing an assigned task and perhaps doing it better or faster 
is rewarded. Competing for grades, or a spot on a team, or 
to be a cheerleader is training for competition in adult life. 
Going to school also means being evaluated. Children are 
constantly having their words and deeds judged by others. 
The job of teaching becomes in large part one of creating 
competitions and judging the results. Order and control are 
necessary because the collective experience requires the 
subordination of individual to institutional objectives. Some 
institutional objectives are culturally determined and consti- 
tute the "hidden curriculum" of the schools. Order and 
control also ensure that the lessons (competitions) proceed 
according to schedule. 
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6. The knowledge ,ind skills to be transmitted to the 
children are expressed in cognitive terms rather than in 
terms of social or vocational development. 

The concepts and skills of reading, mathematics, history, 
science, and so on define the expressed curricu' ti of schools. 
The individual lessons are selected by teachers to cover an 
aspect of a concept or skill within a given time slot. In 
practice-, however, teachers' decisions about what to select 
are often limited in spite of the apparent latitude to arrange 
schedules and select activities. In most schools the concepts: 
and skills which are to be taught in a discipline are provided 
for teachers via a curriculum guide, a syllabus, or most often 
a textbook. Such materials rarely give teachers many alterna- 
tives. Thus, the knowledge to be transmitted to children is 
largely determined by commercial publishing companies that 
tend to be educationally conservative and slow to respond to 
pressures for change. 

These six characteristics are the traditional ones that 
define school. The real picture of an elementary school is 
that of a work place, Tedchers work, for the most part, 
independent of other teachers with ont group of students for 
a year. Their job is to assign lessons to their class of 
students, start and stop the lessons according to some 
schedule, explain the rules and procedures of each lesson, 
judge the actions of the students during the lesson, and 
maintain order and control throughout. Furthermore, the 
lessons which define the knowledge to be transmitted are 
prescribed by a syllabus (or text) and are organized into 
content-time segments. For students, the job is to be active 
participants in each lesson, attend to the explanation of rules 
and [procedures, work independently on tasks, and try to do 
better than otliers. 

Schools, of course, differ because of the locale, the type 
of ptirents, the particular school's history, and other factors. 
But these differences are only of degree, not kind, and for 
most schools are probably trivial compared to the uniform 
char«jcteristics. In fact, elementary schools are very stable 
social institutions; it is difficult to change any of the funda- 
nirntdl chcirijcteristics of scnools significantly. The basic 
problem facincj reformers is to challenge the traditions upon 
which schooling practice is based. As Popper (I9U9) has 
argued, the rolo of traditions in society is twofold: first, 
traditions create a certain social structuro; and second, 
traditiot^b ijro thmgs we can critici-ie and change. Schooling 
traditions such as {\^(] acje-g rtjded , self-contained classroom 
provide regulcjrities In the social stru ture of schools. The 





mere existence of these regularities is more important than 
their merits or demerits; they bring order and rational pre- 
dictability into the social world of schools. But traditions 
sometimes outlive their usefulness. Traditions in this sense 
are similar to theories. They provide a framework to be 
examined critically and to be altered over and over again. 
Significant reform movements are characterized by challenges 
to widely held traditions; in education such traditions are the 
work of teachers, the work of children, the way in which 
operating decisions are made by the professional staff, the 
structure of the knowledge to be transmitted. That many 
reform movements have failed is not surprising. The tradi- 
tions which have evolved give the participants a sense of 
order which is essential. Superficial attempts to change 
schools have praised the "new" without cliallenging the "old" 
and the traditions upon which the old rested. Thus, one way 
of judging the effectiveness of a reform program is to deter-- 
mine the extent to which the traditions of schooling have been 
challenged and altered, and one way of understanding the 
complexity of schooling is to study reform attempts. 

Periodically, in the history of educational though , 
reformers liave tried to change schools which, they believed, 
were failing to respond to societal changes. Malcom Skilbeck 
(1975) argued that such actions emerge during periods of 
upheaval or rapid social change; for example, the plans in 
France and America In the late eighteenth century for using 
schools as nation builders, more recently the widespread 
interest in using education to accelerate economic progress in 
developing countries. In the past 25 years, a number of 
proposals have been made attacking the traditional characteris- 
tics of schools, programs have been developed based on those 
proposals, and alternate forms of schooling have been adopted. 
It is not the purpose of this chapter to examine in detail the 
conditions underlying the school reform movement of the last 
quarter century of which ICE is a major example. However, 
it is worth noting some of the major events. 

ICE is a product of the mid-igeos and as such is an 
exemplar of the "modern-school" reform movement which began 
in the 1950s, a decade of political turmoil and technological 
upfieaval. The cold war, the Korean war, and the potential 
of nuclear holocaust kept military preparedness and continual 
development of sophisticated armaments a high national priority. 
Conservative retrenchr.ent on the one hand, exemplified by 
Senator Josepfi McCarthy's attacks on "potential Reds," and 
the emergent civil rights movement on the other were focal 
points of America's internal political turmoil during that era. 
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Furthermore, the rripid development of computers along with a 
series of spectacular basic inventions such as the transistor 
were creating new opportunities for giant corporations and 
reshaping most industries. The need for a large cadre of 
scientifically trained personnel was critical and defined pri- 
marily in terms of national survival. 

Schools fit into the arguments of this period in three 
ways. First, one set of educational critics claimed that few 
of the graduates of our schools and colleges had an adequate 
mathematics, scientific, or engineering background. The 
culprits were seen to be the progressive education movement, 
the life-adjustment curriculum, and, in particular, education 
professors. The critics of post-World War II schooling at 
first were dismissed by educators as "cranks," "witch hunters," 
"super-patriots," and so on. But by 1952, Mollis Caswell 
argued that "what was happening was not merely a subversive 
attack on the schools but rather a searching reappraisal of 
(schooling) (p. 12). 

Arthur Bestor, an American historian, became the most 
noted spokesman for the critics. His principal book, 
Educatiorwl Wastelands , published in 1953, was widely re- 
viewed and commented upon. His argument may be summed 
up under three broad headings: a theory of education, a 
conception of the historic role of the public school, and a 
notion of the "great subversion" of American education. The 
purpose of education is "the deliberate cultivation of the 
ability to think." Intellectual training may not be the only 
function of the schools, but it is their raison d'etre. In- 
tellectual training is given through the academic disciplines. 
True education, then, is the deliberate cultivation of the 
ability to think through training in the basic academic dis- 
ciplines: history, English, science, mathematics, and foreign 
languages. 

Bestor then argued that the function of the public school 
is to give such a basic education to all citizens. Democratic 
education differs from aristocratic education only in the 
number of persons with whom it deals, not in the values it 
seeks to impart. To educate the common man through other 
than systematic intellectual training is to rob him of his 
birthright; it is to vulgarize culture under the guise of 
democratizing it. By training all in the ability to think, the 
schools distribute Intellectual power widely among the people. 
This dione is the distinctive way schools contribute to social 
progress. 
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Finally, E3r?5tor believed that the great subversion of 
American education had been the divorce of the schools from 
scholarship and of teacher training from the arts and sciences. 
Bestor's arguments found considerable support within the 
academic community, the press, the military, and even the 
public. In essence, there was a growing belief that the 
lessons children were engaged in failed to reflect the essential 
content of the disciplines and that students in competition 
with one another wore not being judged in terms of "ability to 
think" but on other criteria. 

During this time several siudy groups began to produce 
curriculum materials which emphasized the structure of the 
disciplines. When the Soviets launched the first space satel- 
lite in the autumn of 1957, our shocked nation realized that 
its technological supremacy had been challenged. What fol- 
lowed was the "modern curriculum" movement in which the 
federal government spent considerable sums to have new 
discipline-oriented materials developed and to have teachers 
retrained. Tfie new curricula were deliberately developed 
under the direction of scholars from the disciplines. Experi- 
enced classroom teacf.ers were junior partners in the endcav/or. 
Processors of education, both mathematics or science educators 
<ind educational psychologists, were expressly excluded. 

A second group of educational critics during the 1950s 
argued that schools were psychologically alienating. Spokes- 
men for low-income and minority groups, for example, pointed 
to a pattern in the lack of achievement of school children- 
Critics sharing these concerns made insistent demands that 
schools become more accountable for the learning of all pupils. 
As Charles Silberman (1970) so convincingly argued, "On 
almost any measure, the schools are still failing to provide 
the kind of education Negroes, Indians, Puerto Ricans, 
Mexican Americans, Appalachian whites — indeed, the poor of 
every color, race, and ethnic background — need, and deserve" 
(p. 62). In particular, Silberman argued that slum schools 
were failing "to teach the intellectual skills and academic 
knowledge tfiat students need if they are to be able to earn a 
decent living and to participate in the social and political life 
of the community" fp. 62). Furthermore, he argued, 

it would be unreasonable, perhaps to expect 
absolutely equal results from different schools. 
Lower-class youngsters start school with severe 
educational deficiencies for which the school cannot 
be blamed; moreover, the school as we have already 
argued, is only one of a number of educating 
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institutions and Influences that affect a youngster's 
academic achievement. It Is not unreasonable, 
however, in a society that prizes (or claims to 
prize) equality of opportunity, to expect the 
schools to be a significant influence — to expect them 
to make the opportunities open to its students less 
dependent upon their social origins. And that 
means making it possible for students from every 
social class and every ethnic and racial group to 
acquire the necessary basic skills, (p. 62) 

Finally, based on this concern about "equality of opportunity" 
an array of federal policies and programs were developed, 
based "on the assumption that differences In school inputs 
largely explained the differences In outputs, I.e., student 
achievement, the main thrust of educational policy has been to 
equalize the inputs — to provide the resources and programs 
necessary to bring below-average and average schools up to 
the level of the best" (Silberman, 1970, p. 70). 

The third aspect of the educational debates was less a 
criticism of schools than a prescription of how to produce a 
better system. American belief in science and technology had 
reached a peak in the years following World War II. Many 
believed that the same rational procedures that enabled the 
military and industry to conduct a massive war and then 
provide for an affluent consumer society could be enlisted to 
solve the most pressing social and political problems that 
confronted the United States. 

In 1957 another group of scholars, the psychologists, 
also reacted to the national crisis. Many scholars who had 
never worked in the area of classroom learning volunteered 
vheir services. Lee Cronbach's presidential addrers to the 
American Psychological Association that year set tf.o tone. In 
that speecfi he argued that the historic separation of experi - 
mental psychology from the study of individual differences 
impeded psychological research. He called for a crossbreeding 
to bring forth a science of aptitude by treatment interactions 
(Cronbach, 1957). The psychologists brought to the curriculum 
revolution the constructs, tools, and conflicting theories of 
their discipline. Of the variety of ideas they applied to the 
school reform movement, three major themes gradually emerged: 
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1. Emphasis should be on the cognitive processes which 
underlie the acquisition of the concepts and skills of mathe- 
matics, science, and other disciplines. 

Initially, attention was drawn to taxonomic categories of 
behaviors (e.g., Bloom, 1956), behavioral objectives, and 
learning fiiorarchies (e.g., Cagn6, 1962). These constructs 
were grounded in the behaviorist traditions dominant in the 
psychology of the time. Later, the constructivist psycholo- 
gists joined the fray, led in spirit if not in actuality by Jean 
Piaget. More recently, ideas from the emerging field of 
information-processing have been in vogue. As Shulman and 
Sfiroyer (1978) have pointed out, the roots of this theory 
come from independent publications by Jerome Bruner, George 
Miller, Noam Chomsky, and others during the mid-1950s. 
Indeed the invasion of cognitive psychologists into the field of 
instruction is nearly complete. 

2. Systems analysis founded on behaviorist ideas can be 
used in an engineering model appropriate for curriculum 
development , 

This approach had its roots in the military training 
procedures developed in World War II and the ensuing cold 
war. Educational psychologists who developed military train- 
ing programs returned to major universities and introduced 
engineering models for curriculum development with the same 
fervor that was seen in the larger political realm. Applying 
principles of systems analysis, they gave attention to identi- 
fying taxonomies of learning, organizing hierarchies of behav- 
ioral objectives, constructing objective-referenced tests, and 
developing elaborate flow-diagrams of school organizations as 
d part of tfie effort to use human engineering for school 
improvement. In Essentials of Learning for Instruction 
(1974). Robert Cagn6 argued that all forms of learning are 
hieriirchically organized in relation to one another, with 
classicdl and operant conditioning as the foundation for the 
hierarchy and problem solving at its peak. Thus, any form 
of learning could be reduced to its components and these 
could be systematically taught in a guided fashion to ensure 
learning. Programmed instruction was the fir^i product from 
thi^ .jpproacfi which later yielded a variety of programs to 
[provide differential instruction for students. The rationale of 
the systert^s analysts was and continues to be to improve the 
efficiency of the instructional system. 

Individu.il differences among students, particularly in 
U»<^rrurKj rMc and aptitudes, are of major interest. 
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The work of a number of educational psychologists 
during the 1950s had been to extend and document the 
Thurstone tradition of distinct mental abilities (Anastasi, 
1958). By 1963 this interest in differences in individual 
aptitudes led to concerted efforts to create curriculum mater- 
ials that could be adapted to take into account these differ- 
ences. Recall Cronbach's (1957) pl3a for individual differ- 
ences research in the design of instruction. These materials 
were labeled programs of individualized instruction, and the 
schools reorganized to use these programs were labeled Indi- 
vidualized schools. ICE is one of the most extensive programs 
designed to deal with individual differences of students. 

By taking the impetus to change the curriculum content 
and adding to it the influence of psychologists, some re- 
formers hoped to change the prevalent characteristics of 
schooling. A variety of instructional programs had previously 
been constructed as alternatives to the age-graded, lock-step 
system in which all student studied the same materials at the 
same time. Gibbons (1978) pointed out that such programs 
date from the post-Civil War period. Correspondence courses 
began as early as 1J73, and self-paced units of instruction in 
1888. Most of those programs for changing tradiiional instruc- 
tion were also referred to as individualized. But in the early 
1960s, after d decade of clamor for educational reform, indi- 
vidualized programs were returned to the scene with new 
enthiusiasm. Tod::/ ii is hard for us to reconstruct the 
euphoria of thai period. John Kennedy had just been elected 
P. esldent; the space prog "am had just started; and new 
monies for educational research and development were forth- 
coming. The prevailing opinion during thot era was "given 
time and resources, Americans can do anything." 

Unfortunatelv the resulting variety of prop* ims using 
the label individualized constituted a diverse family, since 
they were based on different theoretical notioni'. about knowl- 
edge and learning and different technologies. The label 
individualized instruction is ambiguous beca''<^e 'l involves two 
basic ideas stemming from different intellectual traditions: 
tho recognition of individual differences in modern psychology 
and educatior., and individualism as an ideological cor;struct in 
American political history. 

The study of individual differences grew with the increas- 
ing sophistication of the testing move* .ent. It \;as clear that 
people diffor on a variety of physical, intellectudi , and per- 
sonality traits. Psyciiologists jssumed that these traits were 
biological in origin and therefore stable. The argur.eni was 
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that these differences, when identified, should be considered 
in schooling. The implication was that, by attending to such 
differences, instruction would be more efficient. In fact, 
what was being argued is that the traditional classroom is an 
inefficient arrangement for appropriate instruction. However, 
note that this idea challenged neither the hidden curriculum 
of the schools nor the expressed knowledge and skills to be 
transmitted by them; it challenged only the fundamental 
grouping practices in schools. The content of lessons, the 
nature of competition, and the work of children In schools 
we»-e not to be different because the teacher understood how 
individuals differed: for example, teachors who were aware 
of individual differences in rate of learning could only make 
variations in allocated time for students or provide alternate 
materials; teachers could not restructure the group of students 
under their tutelage. 

The discussion of individual differences by learning 
psychologists came from two distinct philosophic schools of 
thought (Bourne, 1966). One pictured the learner as a 
passive recipient of information from hi. J environment (asso- 
ciational learning); the other saw the learner as an active 
participant who entertains and tests hypotheses (co'^structive 
learning), both schools have their merits, but the work of 
children would clearly differ under the two philosophies. 
Thus, the goal of providing more effi-^/ient instruction by 
attending to inciividual differences is not simple to define or 
to attain. 

Indiv'iualism as an ideoloc; al construct in political 
thought involves the liberal belief In the autonomy of the 
individual against the demands of the system. Cagan (1978) 
suggested there are three distinct components of this belief: 

1. self-deterr.iination--the individual is in control 
of his own destiny; 

2. sel -actualization'-the good life is attained 
through acting on one's personal needs and desires; 

and 

3. self-direction--one is free from social con- 
straints. 

Individualized programs based on this construct challenge the 
control mechanisms of schools (both time and the hidden 
curriculum) and the expressed knowledge and skills to be 
transmitted. From this standpoint the traditional classroom 
with its hidden curriculum of competition, evaluation, order, 
and control is seen as an organization which ^osters Wiappro- 
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priate instruction. This attack has come both from advocates 
of social individualism demanding more self-dlrection and from 
socialist educators demanding a collectivist pedagogy that 
would emphasize interdependence and cooperation rather than 
independence and competition (Cagan, 1978). Individualism 
assumes the existence of individual differences but does not 
consider identification of those differences particularly rele- 
vant. In fact, radical reform proposals (Cross & Cross, 
1969) often attack the engineering of individualized programs 
as just more sophisticated means of social control. 

The distinctions between ^'individualization" and "indi- 
vidualism" are subtle but important. Programs of "individual- 
ization" are based on assumptions about biological traits and 
a3:iociational learning. "Teacher-proof" materials are the 
outcome of most programs of individualization. The teacher is 
seen as the operator of 2 complex engineered system. "Indi- 
vidualism" on the other hand is based on assumptions related 
to constructive learning paradigms. The teacher is viewed as 
a guide who provides students a rich environment in which to 
yrow and mature. 

In summary, reformers in the early 1950s believed that 
the knowledge schools were transmitting was out of date and 
that the competition of instruction was not sufficiently related 
to thinking. Toward the end of that decade children's 
intellectual differences took on more importance and systems 
engineering was thought to be a technique for developing 
more efficient schools. 

We are beginning to understand that challenges to one or 
more primary characteristics of an institution bring about new 
attacks, both on the assumptions of that challenge and on 
other primary institutional characteristics. Thus, the proposed 
changes which seemed so straight-forward in the immediate 
post-Sputnik era now are viewed as complex and even chaotic. 
The object of study in this book, ICE, grew out of the 
turbulence of the past quarter-century. ICE was conceived 
and evolved during the per'od of enthusiasm for rational 
planning and was believed to provide a significant alteration 
of rxhooling practices in elementary school. It was based on 
three assumptions. 

Fir.., it was assumed there was tacit consensus among 
d.i educators on the goals of elementary education. The term 
"eftective education" was used to describe an "education that 
yields high student achievement, develops the abilities under- 
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lying thosu nchievements. and contributes to healthy person- 
ality development'' ( Klausmeier . 1977. p. 7). Put bluntly it 
was "assumed that the learning of each individual child must 
be the focal point of the school" (Romberg, 1969, p. 1). 

Second, because American schools and school systems 
differed, at least on the surface, what was needed to reacn 
the agreed upon goals for elementary schools was not a 
product but a process, a problem-solving procedure which 
would allow each school to respond to local conditions. 

And third, it was assumed that the major impediment to 
more effective scfiooling was the organizational constraints of 
tfie age-graded, self-contained classroom. The staff of a 
typical elementary school building in the mid-1960s was organ- 
ized in a way that prevented teachers from developing or 
executing an effective educational program. Herbert 
Klausmeier summarized this point as follows: 

As the Wisconsin R&D Center got underway in 
1964-1963, it was found that the usual elementary 
school environment hampered, rather than facil- 
itated, cooperative research and development by 
school people and the Center staff. The usual 
elementary school had a building principal and a 
number of certified teachers, each equally re- 
sponsible for the instruction of about thirty 
children, and each being involved with children 
throughout most of the instructional day. The 
whole staff spent most of its energy and time in 
keeping school going, not in curriculum improve- 
ment, research, development, or innovation. The 
atmosphere was one of frustration. The staff 
wanted to move ahead, but could not. 

Four limitations of this environment merit brief 
attention. First, teachers busy with children with 
no time to share in identifying research or develop- 
ment projects, in planning the projects, or in 
carrying them out, properly recognized that little 
constructive work could be done after school hours 
as jn unpaid overload. Second, each teacher had 
to be treated as equally capable of carrying out 
research and development activities. Differentiated 
responsibilities had not been worked out whereby 
bonio teachers could take greater initiative and 
responsibility than others. Third, working and 
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other conditions did not permit principal and 
teachers to mount an effort within the building to 
utilize available knowledge or best practices in 
developing excellent programs. For example, many 
schools in 1964-65 had moved only partially from 
traditional to modern mathematics after ten years of 
effort; some teachers were still using 1925 methods 
with 1965 textbooks. Fourth, each classroom, 
operating as an independent unit, did not allow for 
appropriate research designs, especially "ran*- 
domization" of children or teachers according to 
instructional treatments. (Klausmeier, 1970, 
pp, 49-50) 

The three assumptions on which ICE was based directly 
challenge the traditional characteristics of schools. For 
example, the assumption about consensus among educators on 
goals was made by the ICE developers in spite of the fact 
that educational goals then (as now) were expressed in a 
bewildering array of statements made from many ideologically 
divergent, personal standpoints. Some schools' goals were 
stated for individuals; to learn a useful trade, to make life 
interesting and enjoyable, to acquire basic knowledge and 
skills, to become independent. Other goal statements were 
public oriented: to contribute to an informed citizenry, to 
promote social efficiency, to create o stable world order, 

A realistic appraisal of consensu?; nn tlie aims of school- 
ing was made difficult by other factors as well. First, there 
is no national stem of education; insvOad there are even 
now about 16,000 separate school systeii s each reflecting in 
part the social characteristics of the cultural groups it 
serves. And second, stated goals often are mere rhetoric 
and not reflected in schools. In fact, the expression of 
high-sounding but unattainable aims often is misleading, for 
similarly stated goals often reference different actions. To 
know what schools are about, one needs to know what teachers 
and students do. The dis*:inction between means (actions) 
and ends (goals) has been common in educational disv.ourse, 
but as John Dewey (1916) so forcefully argued, the first 
thing to look to when there is a question of aims is the 
nature of work both of teachers and students. It was claimed 
by the ICE developers that what most schools did was maintain 
an existing and ineffective instructional program (Klausmeier, 
Morrow, b Walter, 1967), and this needed to be changed. 
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Nevertheless, and perhaps paradoxically, it was believed 
that educators agreed t *. t schools could be focused on indi- 
viduals, could be more efficient and more effective. In 
essence, they could provide each student an effective educa- 
tion. All that was needed was help, and help was on the way 
in the form of findings and products from the newly estab- 
lished research and development centers with support from 
federal funds. If the focus of schools was to be on the 
learning of individual children and if school staffs used 
rational procedures to plan for their Instruction, common alms 
could be met. The instructional activities might be different 
because of individual or cultural differences, but an effective 
education for all was possible. 

In the next chapter, ICE is briefly described as it was 
conceived and as it evolved in response to these assumptions. 
In particular, the evolution of a rational system of schooling 
which directly challenges the traditional organizational and 
procedural characteristics of elementary schools is presented. 

Finally, for the evaluation project, our intent has been 
not only to describe the features of practicing ICE schools 
and their empirical effects, but also to examine the assump- 
tions and relations of the reform movement itself. The design 
of the study, outlined in Chapter 3, began by considering 
the complex dual forces of stability and change. In partic- 
ular, the question of how the six characteristics of schools 
summarized earlier were actually affected by ICE guided the 
overall evaluation design. 
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CHAPTER 2 



ONE AT A TIME TOGETHER: 
THE IGE APPROACH 
TO ELEMENTARY SCHOOLING 

Thomas A. Romberg 

In this brief chapter, it is impossible to identify all of 
the ideas proposed by various scholars and practitioners or to 
report all of the events which led to the ICE system of elemen- 
tary education. Rather, some of the guiding principles of the 
system are pointed out; the components of the system are 
outlined; the steps taken to implement the iC£ system nation- 
wide described; and the resulting ideal system is examined in 
terms of its challenge to the traditional characteristics of 
schools discussed in chapter 1. 

In the 10-year evolution of ICE, three characteristics 
were constant. First, while there was a vision about effec- 
tive education, about what schools could be like, and a belief 
that the vision could be realized, ICE was not an ivory-tower 
product. The ideas were not merely logically derived by 
scholars from a philosophically rigorous model of . '<*truction 
or schooling. The ICE system of elementary education gradu- 
ally developed as scholars from the Wisconsin R s D Center 
cooperated with local school administrators and teachers who 
were attempting to provide effective education for all stu- 
dents. 

Second, as ideas were put forward, th ^ were tested in 
the cooperating classes and schools. What evolved was a set 
of practical suggestions about how to operate a school and 
how to carry out instruction. These suggestions, stated in 
terms of ICE components and per formance objectives, were all 
related to actions which had been tried out in schools, and 
subsequently revised if necessary, and were believed to be 
importantly related to the underlying notion of effective 
schooling. 

Third, as aspects of the system became fixed in the 
cooperating schools (ICE components identified and perform- 
ance objectives specified), it seemed that other schools could 
adopt the same features. Implementation of the ICE system of 
elementary schooling in other sites across the nation became a 
major goal of the U.S. Office of Education and the National 
Institute of Education as well as the Wisconsin Center. 
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IGE AS EFFECTIVE EDUCATION 



The staff of the Wisconsin Center believed schooling 
could be better. Effective education was assumed to be the 
outcome in schools where 

le individual students learn at rates appropriate to 
each student and in a manner suitable to each 
student's learning style and other intellectual and 
personal characteri«;tics. Students, upon completing 
ICE elementary schooling, should have achieved 
more than in other kinds of Jchools, should have 
acquired higher-level conceptualizing skills and 
other abilities which enable them to continue to 
learn, and also should have developed healthy 
self-concepts. (Klausmeier, 1977b, p. 7) 

This notion is focused on three aspects of schooling; 
first, that students differ, as discussed in chapter 1, and 
their differences should be considered in schooling; second, 
that the purpose of schooling is for students to acquire 
predetermined cognitive skills; and third, that the problem 
facing schools Is to create a facilitative environment where 
such learning is possible. 

It was> assumed that teachers and administrators wanted 
improved instructional programs. With the increase in school- 
related research, the extensive "modern" curriculum develop- 
ment efforts, and a variety of creative instructional innova- 
tions, all thai seemed necessary was to provide schools an 
alternative organizational plan and a set of procedures to 
follow. In 1965-66, the second year of the Wisconsin Center, 
a project called Maximizing Opportunities for Development and 
Experimentation in Learning in the Schools (Project MODELSj 
was begun "to improve student learning and also to provide a 
facilitative environment for school related research, develop- 
ment, and innovation" (Klausmeier 6 Quilling, 1967, p. 1). 
It is from that project and the related work in schools that 
the ideas of ICE evolved. 

Over the ensuing ten years it became clear that the 
following conditions were together necessary in order to 
produce high quality instruction focused on students: 
"clearly defined roles and reiponsibilities , shared decision 
making, continuous pupil progress, personalized instruction, 
active learning, evaluation related to instructional objectives, 
involvement of parents and support from the community, and 
support by responsible education agencies" (Klausmeier, 
1977b, p. 7). 
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THE COMPONENTS OF IGE 



The conditions listed above became incorporated into a 
total system of schooling as seven components: 

1 . instructional programming for the individual student; 

2. multiunit organizational-administrative arrangements; 

3. evaluation for educational decision making; 

4. curricular materials compatible with ICE; 

5. home-school-community relations; 

6. facilitative environments for ICE; and 

7. the continuing research and development required to 
improve ICE. 

The following descriptions of six components are abbre- 
viated from those provided by Klausmeier {1977b, pp. 10-22). 
The description of curriculum materials is based on Romberg 
{1976a, pp. 232-23U). 

The Instructional Programming Model 

To adapt instruction to the needs of the individual, a 
model of instructional programming was conceptualized to 
facilitate each student's development (Klausmeier, Sorenson, 6 
Quilling. 1971). The purpose of this model, shown in 
Figure 2-1, is to portray each individual student in terms of 
an initial level of performance, rate of progress, style of 
learning, motivational level, and other characteristics, and to 
situate this portrayal of each student in the context of the 
educational program of the school. Thus, the information 
base for interaction begins with knowing a lot about each 
individual student. Second, this knowledge is to be used in 
light of the school's goals to teach a predetermined set of 
cognitive skills. The model is used with explicitly stated 
instructional objectives and related criteria of attainment 
which indicate that every student should attain mastery of 
certain objectives before completing elementary school. 
Instructional programming for the individual student should 
not be interpretea to mean that all students engage in the 
s<iirie number or kinds of activities, or reach an identical level 
of achievement, interest, or niotivation. It does imply that 
objective-referenced instruction may proceed differently for 
different kinds of objectives within the same curricular area 
and also across various curricular areas. 

It tjiso implies that, while Instructional programming is 
done for each individual student, instruction (Step 5) is 
provided for groups of students with common learning needs. 
In practice such grouping of students usually led to in- 
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Step 1. 



Step 2. 



Step 3. 



State the educational objectives to be attained by the student 

population of the building in terms of level of achievement 
and in terms of values and actio oatterns. 



Estimate the range of objectives that may be attainable for 
subgroups of the student population. 



r 



Assess the level of achievement, learning style, and motivation 
level of each student by use of criterion-referenced tests, 
observation schedules, or work samples with appropriate-sized 
subgroups. 



Step 4. 



Step 5. 



Step 6. 



Step 7. 



Set instructional objectives for each child to attain over a 
short period of time. 



Plan and Implement an instructional program suitable for each 
student or place the student in a preplanned program. Vary 
(a) the amount of attention and guidance by the teacher, ib) the 
amount of time spent in interaction among students, (c) the use 
of printed materials, audiovisual materials, and direct experiencing 
of phenomena, id) the use of space and equipment (n»dia), and 
ie) the amount of time spent by each student in one-to-one 
interactions with the teacher or media, independent study, adult- 
or student-led small-group activities, and adult-led large-group 
activities, , 



Assess students for attainment of initial objectives. 



Objectives not 
attained to 
mastery or some 
other criterion 







Objectives attained 

to mastery or 
some other criterion 



Reassess the student's 
characteristics, or 
take other actions. 



Implement next 
sequence in program, 
or take other actions. 



U4 



( Feedback ) — — — * — 



Figure 2-1 



Instructional Programming Model in IGE 
(Adapted from Klausmeier, Quilling, Sorenson, 
Way, 6 Clasrud, 1971, p. 19). 
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struction on a content unit for two to three weeks, followed 
by post-assessment, some regrouping of students, and in- 
struction on another content unit. 

Multiunit School (MUS) 

The multiunit school organizational structure emerged 
initially through cooperative problem solving by personnel of 
the Wisconsin Center and local school districts. The problem 
to be solved was how to group and regroup students with 
common learning needs for effective and efficient instruction. 
The procedural steps of instructional programming for each 
individual student are unmanageable by teachers In the 
typical self-contained classroom. The organizational 
structure, shown in Figure 2-2, replaces the age-graded, 
self-contained classroom organization for instruction and the 
related administrative relationships. The Instruction and 
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school settings. 



Figure 2-2. Multiunit organization of an ICE school of 400-600 
students (Adapted from Klausmeier, Morrow, 6 

Walter, 1 968, p. 19). ^Instruction and 

Research Unit; ■ Instructional Improvement 

Committee; Systemwide Program 

Committee. 
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Research (I & R) Unit replaces the self-contained classroom 
organization for instruction, A Unit Is comprised of a group 
of teachers who plan and carry out the steps of Instructional 
programming for each student and provide Instruction to 
groups of students with common learning needs. 

The Instructional Improvement Committee (ilC), composed 
of the principal and the Unit leaders, replaces the principal 
as the sole educational decision maker at the building level. 
The main functions for which the IlC takes primary initiative 
are formulating the general educational objectives for the 
entire school building, interpreting and implementing system- 
wide and statewide policies that affect the educational program 
of the building, coordinating the activities of the I & R Units 
to achieve continuity in all curricular areas, and arranging 
for the use of the time, facilities, and resources that are not 
managed independently by the Units. The IlC thus deals 
primarily with planning, decision making, and coordinating 
the activities related to instruction. 

The Systemwide Program Committee (SPC) is a new 
organizational arrangement at the school district level. Its 
decision-making responsibilities are identifying the functions 
to be performed in each ICE school of the district, providing 
for the recruiting of personnel for each ICE school and for 
their inservice education, providing the essential physical 
resources and instructional materials, planning an effective 
program of home-school-community relations for the district, 
and providing for the transition of students from the ICE 
elementary school to middle school or junior high school. 

These three groups—the I S R Unit, the IlC, and the 
SPC— assume responsibility for planning, decision making, and 
evaluation at the three respective levels and also for com- 
munication within the school setting and between the school 
and the community. 

Evaluation for Decision Making 

The third major component of ICE is a model of eval- 
uation leading to decisions which will facilitate student 
learning through use of the instructional programming for the 
individual student. In ICE, the evaluation of the student's 
learning characteristics and achievements is aimed at pro- 
viding information at three times: prior to being grouped for 
a unit of instruction, during the instructional sequence, and 
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at the end of a unit of instruction. The IIC, interacting with 
the staffs of the I & R Units, is responsible for formulating 
objectives and criteria at the building level, ;jnd the I & R 
Urit staff is responsible for gathering the i:iformation. Three 
aspects of evaluation evolved for thii. cor.ponent. The first 
are criterion-referenced tests related to the instructional 
objective; these are used to identify needs and determine 
Instructional groups. The second is a set of motivational 
procedures called Individually Guided Motivation ( Klausmeie*^, 
Jeter, Quilling, Frayer, & Allen, 1975), used to determine the 
motivational level of each child and to encourage each student 
to reach agreed upon objectives. The third encouraged 
judgment by teachers about how students best learned so that 
efficient groups could be formed. The evaluation procedures 
are planned by the same groups, and most measuring is done 
by the individual teachers. Individual teachers are involved 
in relating measurements of particular students to the criteria 
that have been set. Teachers make judgments and act upon 
them in the daily instruction of children; the staff of the I S 
R Unit io so for the children of the unit; and the IIC for the 
child population of the school. 

Compatible Curriculum Materials 

It is at steps 3, and 6 of the IPM (see Figure 2-1) 
that decisions are made about grouping children for in- 
struction. It was evident that the availability of curriculum 
materials that help professional staffs carry out these three 
steps of instructional programming makes the real difference 
in whether or not ICE works. 

Early attempts at carrying out the steps of the IPM were 
hampered by five characleristics of most available curriculum 
materials: 

1. They had no clearly specified instructional objectives. 
Content to be covered was implied by the basal texts in use, 
but outcomes were not well identified, 

2. They had no objective-referenced assessment procedures, 

3. Suggested instructional activities were not keyed to 
objectives, 

4. They lacked a variety of instructional activities which 
could be used for children with different styles of learning. 
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5. They did not have efficient ways of keeping records of 
children's progress. 

There were two basic ways to overcome these deficien- 
cies. One was to have ICE school staffs independently de- 
velop the needed rT.iiterials. There are several examples of 
excellent sets of materials developed in this manner. How- 
ever, such efforts often resulted in a * cut-and-paste" pro- 
gram which had an inadequate and incomplete set of ob- 
jectives, poor tests, and incomplete sets of instructional 
activities. Preparing good curriculum materials which over- 
come the five handicaps listed above, and at the same time 
are conceptually sound and comprehensive. Is an expensive, 
time-consuming task. 

The second way of developing curriculum materials was 
to have a staff of content experts and practitioners with 
adequate resources prepare materials that could be readily 
adapted by professional teachers for their students. This 
was the approach taken by the curriculum development pro- 
jects at the Wisconsin Center. 

The thf'ee principal curriculum projects of t\\e Center 
produced the Wisconsin Design for Reading Skill Development 
(WDRSD) (Otto S Askov, 1974), the Pre-Reading Skills 
Program (PRS) (Venezky, Pittelman, Kamm, S Leslie, 1974), 
and Developing Mathematical Processes (DMP) (Romberg, 
Harvey, Moser, & Montgomery, 1974, 1975, 1976). In 
developing each program, the project staffs were faced with 
the s.ime basic problem — overcoming the five handicaps above. 
However, due to differences in content and availability of 
instructional materials, the final sets of curriculum materials 
differ significantly from each other. 

All three projects carefully developed lists of objectives 
and criterion-referenced assessment procedures and specified 
record-keeping procedures. But because of different ways of 
organizing content, and different patterns of objectives 
(common or variable objectives, full or variable attainment, 
and invariant or variant sequence), the programs differ from 
one another in these features. 

The biggest difference, however, is with respect to 
instructional materials. In reading, it was decided that 
sufficient materials for teaching most of the essential skills 
were ijiready available. Consequently, WDRSD includes 
resource files for teachers which provide a means of 
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organizing existing materials and activities. The published 
files include only a sample of appropriate resources related to 
each objective. Teachers are expected to add other resources 
they judge to be relevant to the objectives and to the needs 
of their pupils. 

In developing both PRS and DMP, it was decided that 
materials for teaching most of the objectives had to be 
created. Since prereading skills was a new content area, 
very few materials even existed. In mathematics, almost all 
existing materials reflected the modern structural approach to 
mathematics which had proven to be inappropriate for ele- 
mentary school children (Romberg, 1976b). DMP was devel- 
oped from a modeling-process approach to mathematics, using 
measurement as the basis of modeling. Furthermore, it was 
assumed that knowledge, skills, and values are not simply put 
into students, rather they are are acquired through active 
participation. Sensing, manipulating, and self-directed 
participation are reflected in the activities developed for both 
PRS and DMP. These include games, manipulatives , experi- 
ments, and materials for learning stations. Both PRS and 
DMP are complete instructional programs which are packaged 
in kits for convenient use by teachers. 

The organization of materials In all three programs, 
WDRSD, PRS, and DMP, encourages teachers to recognize and 
meet the needs of each child. The teachers* materials 
emphasize flexibility in grouping children, sequencing 
instruction, and varying instruction for individual children. 
The assessment procedures enable teachers to determine each 
child's progress and plan appropriate instructional activities. 

It should be noted that reading and mathematics were 
the two areas of primary concern. It was assumed that other 
instructional materials suitable for use in ICE schools were 
being developed. In addition to the Wisconsin Center, other 
centers, regional educational laboratories, and nonprofit and 
profit-making organizations were producing a wide variety of 
high quality curricular materials. The following procedures 
for identifying and using appropriate materials were recom- 
mended: terminal educational objectives related to the major 
curricular areas were to be formulated at state and school 
district levels. Then, available printed and audiovisual 
instructioruil materials were to be identified by a repre- 
sent^jtive committee of teachers and administrators. From this 
list, lie cHul I s R Units of a sclnool were to select the 




materials which were appropriate for each student to attain 
specified instructional objectives. Each building staff was to 
continuously recommend to the district committee the specific 
materials needed for the students in a particular school and 
community, 

Home-School-Community Relations 

The success of any school program depends in large 
measure on relations with the community it serves. In ICE 
schools, there should be three general aims of a home-school- 
community relations program: first, that the staff be aware 
of available resources and be responsive to the educational 
expectations of the community, parents, and students; second, 
that the community, parents, and students be aware of and 
responsive to the requirements for implementing ICE; and 
third, that both staff and community be involved in the 
changeover and refinement of ICE. 

At the level of the school district, the larger community 
controls the schools through its willingness to expend its 
power and resources on programs which reflect its values and 
interests. If the values held in the broader community are 
communicated, and if the school is responsive to these educa- 
tional expectations, then the community will use its power and 
resources to support the instructional program. 

At the local school level, particular attention should be 
accorded parents. Parents often hold expectations for the 
school which are more specific, and perhaps less objective, 
than those of the wider community. Because of their intense 
interest, the parents collectively constitute the most influ- 
ential school-related group; they have the greatest impact on 
actual awareness and potential political actions within the 
larger community. 

At the instruction level, parents must have a clear 
understanding of the school's aims regarding the development 
of their children. Because roles and functions may differ in 
the ICE school, parents also must understand the organization, 
programs, and procedures used. To develop such understandings, 
the Unit staff must provide an effective program of home- 
school-community relations. At the level of instruction, the 
family directly affects the individual student's abilities, si<ills, 
and attitudes. 



21 



ERLC 




Facilitative Environments^ 



A system of supportive and facilitative environments is 
required to maintain and strengthen each ICE school so that, 
in fact, each school becomes increasingly self-renewing. 
Facilitative environments, consisting of human and material 
resources, are both intraorganizational and extraorganiza- 
tional. The intraorganizational environment is represented in 
the multiunit organizational structure, and the focus is on 
providing the physical and material resources needed for 
learning and instruction. Extraorganizatlonal facilitative 
environments are represented in the state education agency, 
intermediate educational agencies, teacher education insti- 
tutions, and other groups such as teachers' associations and 
parents' organizations. 

Continuing Research and Developments 

The seventh and final component of ICE, a program of 
continuing research and development, ensures the continuous 
improvement of ICE. Without this component, ICE, like any 
other form of schooling, will become sterile, unresponsive to 
the changing nature of society, and incapable of adapting to 
the needs of individual students (Klausmeier, 1972b). 

GENERAL OBJECTIVES AND 
PERFORMANCE OBJECTIVES 

To provide guidance to school staffs implementing each 
of the seven components, two kinds of objectives were devel- 
oped. The first were 11 general objective^, related to four 
implementation phases; one for the awareness phase, one for 
commitment, seven for changeover (one for each ICE component), 
orie for refinement, and one for renewal (Klausmeier, Kargas, 
b Krupa, 1977). The second were detailed performance 
objectives to guide school staffs in specific actions and help 
them evaluate their implementation of the ICE components. 



The meaning of the term facilitative environments 
changed in the ICE literature from 1966 to 1977. Initially the 
Unit was seen as a "facilitative environment" for research, 
(Jovelupment , and innovation. Later the term was used as in 
this section to refer to a supportive system both within and 
outside the school. 
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For example, for the changeover phase one stated perform\ 
ance objective dealing with the I 6 R Units' use of the IPM 
is: 

Each unit assigns each student to an instructional 
group on the basis of assessed level of attainment 
of specific instructional objectives, learning styles, 
and level of motivation, (Klausmeier, Kargas, & 
Krupa, 1977, p. 349) 

Over 80 similar performance objectives were developed. It is 
against these performance objectives that a school staff can 
judge whether or>not their school is truly an ICE school. ^ 
The implication waS' that the more of these perforfr^nce objec-- 
tives that were met, the more "ICE" the school; ancNiji fact, 
an ideal ICE school would one that met all the objec^Wes, 
Also, it is from ^ consideration of these performance obje-sc 
tives that we wert* able to study variations in performance 
this study. 



IMPLEMENTATION OF IGE 

Because in the ICE Evaluation Project we planned to 
gather information from a sample ^f schools that had been 
attempting to implement the compor'*is?Tits . some information 
about the implementation strategy se^-qis warranted. In fact, 
both the ICE system of elementary sch'b^ling and the imple- 
mentation procedures are of necessity bemg evaluato.d in this 
study. 

With the passage of the Elementary and Secondary Edu- 
cation Act in 1963 and the start of the r & d centers pro- 
gram, there was an unchallenged belief in what has come to 
be known as the "research — ►development — ►diffusion" 
perspective with respect to planned educational change (Clark 
& Cur^a, 1967). This model of change is characterized by a 
sequence of planned, coordinated activities and a rather 
passive target population. The argument fo^ implementing 
programs of r 6 d centers beqan with the cUnm that the 
involvement of the federal government as an active partner in 
education with the state and local schools made available a 
new source of support. Federal dollars accelerated a program 
of research and development at all levels resulting in a host 
of new programs and approaches designed to meet identified 
educational needs. From this position, leading educational 
administrators such as William Kahl , Wisconsin Superintendent 
of Public Instruction, concluded the argument by stating that 
the state Department of Public Instruction "must be respon- 
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sible for the instdllution of improved educational practices in 
the school districts of the state" (Kahl, 1967, p. 1). The 
multiunit school organization and then the ICE system were 
identified as new programs which were a "promising compon- 
ent of a facilitative environment for the individualization of 
instruction and learning" (Kahl, 1967, p, 1). 

The key historical events which led to the national 
implementation of ICE have been outlined by Klausmeler 
(1977b) and are briefly summarized here. In 1968, the 
Wisconsin Department of Public Instruction selected the 
multiunit school concept for statewide demonstration and 
implementation during the 1968-69 school year. The Center 
staff then proceeded, with the assistance of staff members of 
the Wisconsin Department of Public Instruction and local 
schools, to develop a book and 15 videotapes for use by state 
education agencies, teacher education institutions, and other 
educational agencies interested in assisting locol schools make 
the changeover to ICE. 

In 1969, an agreement was entered into between the 
Wisconsin Center and the Institute for Development of Educa- 
tional Activities (/l/D/E/A/) providing for /l/D/E/A/ to use 
the prototype materials in producing a more sophisticated set 
of new inservice materials. /l/D/E/A/ incorporated into the 
new materials some insights gained from their study of educa- 
tional change. In 1970-71 and thereafter, /l/D/E/A/ used 
these 'MCE Change Program" materials to prepare "facilitators" 
to start ICE schools (National School Public Relations Asso- 
ciation, 1972J. 

In 1970, the Council of the Creat City Schools anu 
Teacher Corps decided that the multiunit school was an ideal 
school environment for their collaborative Portal Schools 
Project (Lutonsky, 1971). 

Early in 1971, the multiunit organization component of 
ICE was selected by the USOE for nationwide implementation, 
and the Wisconsin Center started its first large-scale imple- 
merUat«on effort. The Center was funded to carry out a 
comprehensive program to implement various components of 
ICE during 1 971-72 and 1972-73. The National Institute of 
Education (NIE) funded a small continuing effort during 
1973-74 and thereafter, continuing through 1976. 

In 1 972 , the Sears-Roebuck Foundation invited a pro- 
posal that led to its funding of the ICE Teacher Education 
Project at the University of Wisconsin (Klausmeier, 19/2a). 
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This project was to develop seven sets of printed and audio- 
visual instructional materials for use in undergraduate pro- 
grams to prepare teachers for ICE schools; one set for use in 
graduate programs to prepare unit leaders and staff teachers; 
and another set to prepare ICE school principals and other 
administrators (Klausmeier, 1975). Since these materials were 
not available until the 1976-77 school year, the effects of 
these materials on school practices could not be examined in 
this project. 

Finally, in 1973, the Association for Individually Guided 
Education was established by the ICE coordinators of 12 
states, with support of the Wisconsin Center and the ICE 
Teacher Education Project at the University of Wisconsin. 
New theoretical conceptualizations, reports of research, and 
practical ideas for the implementation and refinement of ICE 
are shared in programs at its annual meetings and in the 
organization's publications. As a result of these efforts, the 
number of ICE schools increased rapidly: 50 in 1969-70, 500 
In 1971-72 , approximately 700 in 1973-7.H, and between 2,000 
and 3,000 in 197U-75 (Klausmeier, 1977b). 

The specific R — ►D— implementation strategy used 
by the Wisconsin Center had two key features. First, in 
preparation for the national implementation effort in 1971, a 
plan was formulated consisting of the following four stages: 
awareness, first-year changeover, second-year maintenance 
and refinement, and institutionalization (Klausmeier, 1971). 
Second, a network of cooperating agents was defined. The 
term "network" was used to refer to the formal relationship 
between primary, intermediate, and operational agents to 
effectively carry out implementation and maintenance of ICE. 
The primary agent in the network provides the procedures 
and materials which can be used to change schools. For ICE, 
the primary agents were the Wisconsin Center and /l/D/E/A/. 
The intermediate agent was seen as an organization with 
proven resources and staff to disseminate, demonstrate. 
Implement, and maintain ICE in schools. Depending on cir- 
cumstances, the intermediate agent was a state or intermediate 
education ngency, a teecher education institution, or the 
administration of a large school district. It was the 
responsibility of an intermediate agent to train and monitor 
the operational agents in implementing ICE. An operational 
agent was the organization which actually carried out imple- 
menting change. For ICE, this was the staff of an elemen- 
tary school which actually implemented ICE, i.e., the prin- 
cipal, unit leaders, and teachers. Thus, the Center and 
/l/D/E/A/ worked with the intermediate agents (facilitators) 
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who in turn worked with local school staffs. Also, since the 
needed four phases for ICE were seen to take three or more 
years, the relationship between agents was seen to be long 
term and mutually supportive* 

Scholars involved with ICE were aware of some of the 
limitations of the R — — perspective. For example, 
Herbert Klausmeier, then director of the Center, argued that 
there are many sequences relating basic research, develop- 
ment, and improved practice, not just a single linear 
sequence (Klausmeier, 1968). However, their concerns dealt 
more with the relationship between research and development 
than with implementation. 

In retrospect, the real problem with the R— ^D— 
perspective is its failure to give heed to the users' own 
perception of their needs. Thus, as implementation plans 
were developed, the local problem-solving basis of ICE from 
wfiich its components were developed gave way to procedural 
rules, and the R— perspective rather than problem- 
solving became dominant. 



The components of ICE and the procedures outlined in 
those components were seen as means to an end: the aim of 
ICE was to provide an effective education for each individual 
student. This "one at a time" theme is a direct challenge to 
the pervasive group aims in most schools. A different instruc- 
tional program was to be considered and planned for each 
student. The plans were to take Into consideration both 
social aims and individual aims and were focused on intel- 
lectual growth. 

The procedures first involved considering content in 
terms of "units of instruction." Units were seen as sets of 
related activities in a content area which could be taught in a 
short period of time, possibly two to three weeks, with a 
ndtural beginning and end point. Each unit was objective- 
referenced for assessment purposes in that one or more 
related behavioral objectives were to be identified. Also 
there should be a wide variety of activities so that individual 
differences in learning style could be taken into account. 

Tlicn dn individual's instructional program was to be 
designed dependir'ig on three factors: 
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(1) whether trio objectives incorporated in the unit 
are to be attained by all students, (2) whether the 
criteria that are specified for attainment of the 
objectives are the same for all students, and 
(3) whether the units of instruction are to be taken 
In a fixed sequence. (Klausmeler, 1977a, p. 60] 

Considering these three factors, there are eight possible 
patterns, as shown in Figure 2-3. Then when one considers 
variations in activities within units for different students, it 
is clear that allowances can be made for each student. 

There was a second aim of ICE in addition to effective 
education and that was to create an environment where research 
and development could flourish. This is again a direct chal- 
lenge to traditional pracLlce. Development-based research 
carried out in schools was seen as the dominant form of 
schooling research in the coming decades (Klausmeier, 1968). 
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As has been previously argued, the traditional way in 
which children were grouped in elementary schools--the 
age-graded, self-contained classroom--simply was inappro- 
priate for accomplishing either aim. Instruction in ICE was to 
be accomplished by periodic regrouping of students for new 
units of instruction depending upon need. Regular regrouping 
required that teachers were working with a large number of 
students. Thus, the I 6 R Unit was created and then the 
multiunit school. This change in how students were assigned 
for instruction also challenged how time was allocated and 
when instructional units were offered. Shared decision 
making by teachers to meet individual needs of students was 
to replace the fixed time periods at prescribed grade levels. 
The traditions of instruction and content were challenged by 
focusing on units. Competition and evaluation were still 
emphasized, but they were referenced to Individual needs so 
students were aiming to master some unit rather than to do 
better than other students. 

In summary, the possibility of providing each student an 
effective instructional program guided the development of the 
procedures which together became Individually Guided Educa- 
tion, It wtis seen as a radical departure from traditional 
schoolip'5 practices. The intent of the evaluation project was 
to document the implementation of ICE In elementary schools 
and to understand both how the aims and procedures were 
given meaning by practitioners and how the assumptions upon 
which the components of ICE were built were accepted and 
followed in schools. 
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CHAPTER 3 



THE PLAN 
FOR EVALUATING IGE 

Thomas A. Romberg 

The Wisconsin Center's ability to marshall human and 
financial resources in an attempt to restructure elementary 
education in the United States has been pictured as a prime 
example of the utility of federal financing of educational 
research and development. Through the efforts of the Center, 
/l/D/E/A/, and ICE coordinators in 29 states, by 1976 approx- 
imately 3,000 elementary schools claimed to be IGE schools. 
Unfortunately, no comprehensive picture of the extent or 
effectiveness of ICE was available. This is not to imply that 
no evaluations of ICE had been done. Katzenmeyer, Ingison, 
Zajano, and Romaniuk (1976) found approximately 50 different 
studies that evaluated various aspects of ICE. Each of these 
studies, however, dealt with parts of the ICE system and 
offered only a glimpse of the impact of ICE. Also in 1976, 
responses from over 950 schools to an ICE Schools Question- 
naire clearly indicated substantial variance in affiliation, 
degree of utilization, use of Khe instructional programming 
model (iPM), subject matter selected for IPM implementation, 
staff organization, and so on (Zajano 5 Stewart, 1976). 
Obviously, the translation of ICE into practice had taken 
many forms. Thus, a plan to evaluate ICE was outlined to 
provide a comprehensive picture of the system in operation 
and to determine its effectiveness (Romberg, 1976). 



BACKGROUND TO THE PLAN 

The design of such an evaluation was not easy. ICE is 
not a product like a washing machine to be judged simply by 
performance against competitors as in a consumer report. 
Rather it is a complex system based fon theoretic and prag- 
rndtic ideas about schooling, children's learning, ind the 
professional roles of school staffs. As described in chapter 2 
ICE was the result of a long, collaborative interplay of these 
ideas by various scholars and professional educators. 

A descriptive framework was developed that considered 
outcumes of ICE as a function of instructional means and ot 
the degree of implementation. This framework, presented in 
Figure 3-1, was int^'nded to show four types of variables and 
iiow they are functionally related. Outcomes were separated 
into pupil and staff outcomes. 
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Figure 3-1. Framework for an ICE Evaluation. 
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The functional relationships illustrated in Figure 3-1 
were intended to convey the following: The degree of imple- 
mentation of the ICE support systems along with pupil and 
staff backgrounds directly influence the means of instruction 
in an ICE school. The means of instruction, along with pupil 
and staff backgrounds, account for pupil and staff outcomes. 

Pupil outcomes were the basis 
of the evaluation plan. 

As Klausmeier stated. 

Students, upon completing ICE elementary schooling, 
should have achieved more than in other kinds of 
schools, should have acquired higher-level concep- 
tualizing skills and other abilities which enable them 
to continue to learn, and also should have developed 
healthy self-concepts. (Klausmeier, 1977, p. 7) 

The extent to which these outcomer were attained was basic 
to the evaluation plan. Measuring attainment proved to be a 
difficult problem for three reasons. First, conceptually and 
analytically there is a "unit of investigation" problem. In- 
structional programming is at the individual student level. 
Ideally each student has a different instructional program. 
Thus, to judge the effectiveness of the instructional program 
the student should be the unit of investigation. However, 
instruction on content topics is done for groups of students 
with common learning needs. Effectiveness of instruction 
should be judged on such groups. And planning and regroup- 
ing are dor^e at the I & R Unit level. Thus, data for the 
entire I 8 R Unit should be the basis of evaluation of those 
functions. 

Second, because of the expected variability in instruc- 
tional programming, the sensitivity of instruments to the 
effects of such variability was a problem. Too many tests of 
pupil outcomes are very global and reflect general intelligence 
ratfier than effects of instruction (Berliner, 1975). 

Third, the multivariate/multilevel conception of outcomes 
meant tfiat several different measures of pupil outcomes would 
have to be used so tfiat a composite picture could be formed 
and examined. 

Staff outcomes were also important 

If changed pupil outcomes are a result of chariged pupil 
activities, then it follows that changed means are in part a 
result of changed teacher activities. One established fact in 
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ICE schools is ctidnged staff roles. The extent to which staff 
changes are reflected in increased knowledge about individ- 
uals and schooling or In changed attitudes and values should 
also be reflected in the plan. In fact, if ICE is as dynamic 
as is claimed, then the evolution of a staff to an increasingly 
professional approach to solving the problems of educating 
children should be evident. 

Both pupil and staff outcomes are illustrated as being 
multivariate and multilevel. Pupil outcomes included achieve- 
ment in both reading and mathematics, cognitive skills such 
as conceptualizing and problem solving, and self-direction. 
Staff outcomes included knowledge of ICE principles related to 
individual differences and instruction using the instructional 
programming model, attitudes about children and schooling, 
and perceived values of education. 

The instructional means or form of 
formal schooling was to be examined. 

It has been fashionable in evaluation circles to concen- 
trate on ends or outcomes and to ignore the means by which 
they are reached. It has been persuasively argued in tradi- 
tional circles that means are, by detmition, the optional 
routes to fixed goals. These optional routes are of no sig- 
nificance in and of themselves, but only in terms of the 
contribution they can make to those ends (Olson, 1976), 
Yet, in this case, the form of formal schooling is distinctive. 
Reform movements invariably attack the properties of means. 
Clearly, ICE is an educational reform aimed at changing the 
means of instruction. To this extent judging the means was 
considered as important as assessing outcomes. 

Means of instruction were separated into three sets of 
activities based upon the operating characteristics of ICE 
schools; namely, the staff activities of the IIC (Instructional 
Improvement Committee) and the I 6 R Unit (Instruction and 
.Research Unit), the activities of the staff teacher (both 
curriculum management and pupil in traction), and activities 
of pupils. 

The degree to which the supportive systems 
of IGE have been incorporated and developed 
in a school vv^as to be judged. 

The seven components of ICE had evolved as practical 
features of ICE schools in order to support new instructional 
methods which in turn produced desired pupil and staff 
outcomes. It can be argued that the efficiency of an ICH 
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school is a fupction of which components have been impie- 
mented and how well they are operating. In fact Klausmeier 
(1977) claimed that 

high quality instruction is realized in ICE schools 
when conditions such as the following are operative: 
clearly defined roles and responsibilities, shared 
decision making, continuous pupil progress, personal- 
ized instruction, active learning, evaluation related 
to instructional objectives, involvement of parents 
and support from the community, and support by 
responsibie education agencies, (p. 7) 

The support systems for an ICE learning environment 
were separated into four categories. The first. Compon- 
ents 1, 2, and 3 (the multiunit organization. Instruc- 
tional programming, and evaluation), was seen as most 
directly related to the means of instruction. The second 
category. Component 4 (curriculum materials compatible 
with Components 2 and 3), is shown in the figure as the 
three major curriculum products developed for ICE: 
namely. The Wisconsin Design for Reading Skill Develop- 
ment IWDRSD) (Otto, 1977), Developing Mathematical 
Processes (DMP) (Romberg, 1977), and the Pre-Reading 
Skills Program (PRS) (Venezky 8 Pittelman, 1977). The 
third category. Components 5, 6, and 7 (home school 
relations, facilitative environments, and continued re- 
search and development), was seen as supportive and 
desirable. These later support systems were considered 
less directly related to instructional means than the 
other comporents. 

Pupil and staff background variables were included 
because knowledge of prior pupil achievement, level of 
motivation, and learning styles were assumed necessary 
for etficient grouping of students and selection of 
appropriate activities. Similarly, staff experience with 
ICE principles, with working in groups, and with pupils 
was considered to be important. 

In summary, as a comprehensive system of educa- 
tion, ICE is directed toward the development of self- 
direction and motivation for learning in students as well 
as different levels of achievement. Further, the com- 
ponents are directed toward school staff and community 
members in addition to changing what students do. 
Thus, it was essential to gather data beyond pupil 
outcomes to encompass staff outcomes, the instructional 
means, and the degree of implementation of ICE. 
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DETAILS OF THE PLAN 



Given that there were limited resources to examine 
the framework of variables described above, that instru- 
ments or techniques were not readily available to scale 
reasonable proxy variables for each category or sub- 
category of variables, and that the various relationships 
depicted in the framework called for different analytic 
strategies (status surveys, time-series designs, within- 
school and between-school comparison, and so on), the 
following guidelines were adopted to insure that a 
reasonable portrayal of ICE schooling would be obtained. 

First, a stratified sample of approximately 150 
schools was drawn from a population of some 950 schools. 
Stratification was done on demographic and ICE support 
characteristics to insure a wide variability of schools and 
situations. 

Second, we decided to limit the evaluation to 
teachers and students at the ICE equivalents of second 
and fifth grades. Second grade is the earliest at which 
group-administered paper-and-pencil tests can be given 
to children; fifth grade is the last common grade in 
elementary schools. 

Third, it was decided that resources should not be 
expended on instrument or test development for use with 
the total population. Thus, existing self-report surveys 
and paper-and-pencii tests were selected for use. 

Fourth, the analysis of 'he basic data was to follow 
a structural equations model which accounts for both 
within*-school and between-school variance. 

Fifth, several follow-up studies were to be carried 
out to gather other data over a long period of time on 
subsamples of the original population. 

Sixth, the Center was to subcontract through 
competitive bidding one or more follow-up studies. 



Members of the Advisory Panel were: Chester W. 
Harris, chairman; Arr^o A. Bellack, David C. Berliner, 
David Hamilton, and William Wiersma. 
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hinelly, the evaluation was to be conducted by the 
Center ICE evaluation staft with the assistance of an ICE 
Evaluation Advisory Panel. The evaluation of ICE 
included a preliminary examination of the extent of 
variation of ICE implementation and five operational 
phases* 

Variation in implementation was examined initially as 
a part of the process of identifying a population of ICE 
schools to study and a means of selecting a representa- 
tive sample of schools. The results of this examination 
are reported in chapter 4. 

Phase I was the large sample study to provide basic 
information about ICE schooling. I he specific objectives 
of Phase I were: 

1. to determine the degree to which the components of 
iCE had been implenented in ICE schools. 

2. to describe the implementation of ICE components in 
terms that can be related to means of instruction, par- 
ticularly in reading and mathematics, and then to examine 
the relationship of this implementation to means of in- 
struction. 

3. to describe the implementation of ICE components in 

termb that can be related to staff outcomes, and then to 

ascertain the relationship between this implementation * 

and staff outcomes. 
« 

^. to describe the implementation of ICE components in 
terms that can be related—presumably by way of instruc- 
tional means—to pupil outcomes such as reading and 
mathematics achievement, selected cognitive skills, and 
aspects of personality development, and then to ascertain 
the relationship of component implementation to those 
pupil outcomes. 

The means of instruction and the outcome variables 
ot this study were without question influenced by multiple 
causes that operate simultaneously. This multiplicity of 
causes resists easy description. Since causal relation- 
ships are easier to study when considered in isolation, 
most studies have examined only one or a few causal 
relationships. With respect to ICE, simple comparisons 
between ICE as an undifferentiated package and one or a 
few other educational alternatives proviae us with little 
information about specific features and processes that 
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occur in ICE schools. Using structural equations, 
Khase I simultaneously examined relationships among the 
network of variables believed to influence means of 
instruction, staff outcomes, and pupil outcomes. 

Dd"-^ for this phase were gathered from staff and 
students, in over 150 schools in Fall 1977. A summary of 
the findings from Phase I appears in chapter 5. 

Phase II was designed to verif, the self-report data 
gathered In Phase I as well as to extend data collection 
to include more fully the range of variables that deter- 
mines the processes of schooling. As a verification 
activity, this phase was subcontracted to Research 
Triangle Institute (RTI). Roderick A. ironside of Rll*s 
Center for Educational Research and Evaluation was 
principal investigator. Specifically, the objectives of 
Phase li were: 

1. to determine the validity of the self-report data 
gathered in Phase I. 

2. to use interview and observation data to extend the 
information about each category of variable. 

3. to ascertain the role of developmental agencies in the 
national diffusion process as perceived in ICE schools. 

i*. to gather cost data so that some indications of 
cost-etfectivoness can be determined. 

The areas of cost and of implementation history, 
including the role of developmentc^l agencies, are the 
primary additions to Phase I data. The importance of 
cost analyses has been discussed by Rossmiller and 
Geske ( 1977). Adoption and instituti»^nalization of 
innovative practices nre processes which interest not 
only practitioners and scholars, but also funding agencies 
(Berman & McLaughlin, 1976). 

In Spring 1978 RTI staff contacted and visited 30 
schools that had participated in Phase I. A summary of 
the findings from Phase II appears in chapter 6. 

Phase III was o field study conducted in six 
schools, five of which had also participated in Phase I. 
Each of the six schools had been reported to be an 
exemplary IGE school by one or more ICE regional co- 
ordir^dtors or researchers. The purposes of this study 
were: 
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L to determir>e Ihe degree of reform evident in exemplary 
ICE schools. 



2, to determine the degree of renewal evident in exemplary 
ICE schools. 

In particular this phase focused on the social 
meaning which emerges as ICE is used on a day-to-day 
basis. Research into the impact of educational reform 
suggests that changes in school programs frequently do 
not alter existing patterns, but instead incorporate the 
reforms into the everyday patterns of school life. 
Failure of educational planners to consider the insti- 
tutional patterns of schools has produced unanticipated 
ai i unintended results from reform efforts. Early in 
ine development of ICE, the R&D Center explicitly 
stated that the purpose of ICE schooling was to alter the 
substantive nature of curriculum and instructioti in 
elementary schools (Klausmeier, Morrow, S Waiter, 1968). 

Phase III data gathering was carried out during the 
school year 1977-78. A summary of the findings from this 
phase is in chapter 7. 

Phase IV focused on the use and effectiveness of 
the three primary curricuiar projects developed at the 
Wisconsin Research and Development Center for Cognitive 
Learning, the Wiscon-^in Design for Reading Skills Develop- 
ment IWDRSD). Developing Mathematical Processes (DMP), 
and \he Pre -Reading Skills Program (PRS). Each pro- 
gram was developed to be compatible with the ICE 
system. WDRSD is an objective-based system designed 
o manaqe the development of reading skills for children 
•n grades kindergarten through six. DMP is a complete 
instructional program for elementary mathematics, grades 
kindergarten through six. PRS is designed to provide 
instruction in five basic prereadirg skills at the 
kindergarten level. 

Lt^ch program is being used by a number of schools 
tfiroucj[u)Ul tfie country in a variety of ways. For 
exiipjple, each program is being used in both ICE and 
non-ICE schools. Exactly what t^e capability of each 
program is to be used effectively in a number of dif- 
ferefit situations is unknown. 
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Thus, Ph«i!>€ IV of the ICE evaluation had two major 
purposes: 



1. to describe how WDRSD, DMP, and PRS are being 
implemented; and 

2, to compare the use and nonuse of these programs 
within ICE and non-ICE settings. 

Five studies were conducted as part of Phase IV, 
three Descriptive Studies and two Comparative Studies, 
The Descriptive Studies were small sample studies de- 
signed to describe how the curriculum programs DMP, 
WDRSD, and PRS were being used in ICE schools. Each 
study was conducted during the winter and spring of 
1978. The two Comparative Studies were carried out in 
the 1978-79 school year. Three types of schools were 
included in each study: ICE schools using DMP or 
WDRSD, non-ICE schools using DMP or WDRSD, and iCE 
schools using neither program. A summary of the 
findings of Phase IV appears in chapter 8. 

Phase V was to be a summary report of the first 
tour phases. Phases of the evaluation study were 
designed to complement and strengthen the validity of 
the data gathered by the previous phases. For example, 
data on means of instruction, gathered by the large- 
sample study of Phase I, are examined in greater depth 
in fewer schools by Phase II. Phase Ill's analysis 
develops a view of instruction from a different per- 
spective. Phase IV explores means of instruction within 
specific curricular areas. In Phase V we proposed to 
both summarize the different evaluation phases and to 
integrate and interpret the data from all the phases into 
a series of statements about what implications the project 
has toward contemporary educational issues. This book 
constitutes the product of this phase. 



Ever since Cronbach (1964) .ynd Scriven (1965) 
made the distinction between '•formative" and *'summative" 
evaluations in the literature, authors have vied to 
identify and clarify types, phases, sequences or 
standards and to develcp checklists on evaluation. One 
outcome of these deliberations has been the realization 
that different questions are raised at different times in 
the development of anv program, thus, different informa- 
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tion is needed which must be gathered In different ways. 
A total product evaluation encompasses all such questions. 
The ICE evaluation plan is consistent with the notion 
that there are different questions which need anrwers. 
Thus, the different phases of the plan require different 
kinds of data, different designs, different methods of 
analysis, and different reports of results. However, 
reflective inquiry was at the heart of this plan. We 
hoped to uncover some of the strengths and weaknesses 
of ICE in practice and to identity the unintended con- 
sequences of ICE schooling. The information generated 
and relationships studied were to be a rich source of 
ideas for further investigation. However, It was hoped 
the findings would help school staffs and funding agents 
make reasonable decisions in the future, such as how to 
approach implementation of ICE or at what level to fund 
further long term r & d efforts. 

The literature on planned change is wide in scope 
and vast in quantity, Havelock (1969) reviewed approx- 
imately 4,000 sources in his analysis of the theoretical 
concepts and the research evidence dealing with change 
in education, agriculture, medicine, and other fields. 
Many authors have attempted to provide a model or 
conceptual framework for planned educational change. 

The many models of the change process can be 
grouped into three main classes. The research — ^ 
development diffusion perspective, associated partic- 
ularly with Cuba (1968J, is characterized by a rational 
sequence of coordinated activities, a division of labor, 
and a rather passive target population. Evaluation in 
this "center to periphery" notion of development and 
implementation focused on whether the user at the peri- 
phery has adopted and is using correctly the products 
developed at some central setting. 

The social interaction perspective is basically 
sociological in nature and considers the patin taken by an 
innovation already in existence as it moves through a 
social system. 

The third major type of model for the change 
process views the user as a problem solver. The points 
stressed by the problem-solver perspective are (1) start-- 
ing with the user's need and its diagnosis, (2) providing 
nondirective help from outside, and (3) encouraging t.,e 
user t^ aevelop his own internal resources and his 
capacity for self-renewal. 
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The impkfmentrjtion strategy for ICE attempted to 
combine aspects of both the research development 
diffusion perspective and the user-as-problem-solver 
perspective. The ICE support system is seen as provid- 
ing necessary structural features which make it possible 
for school staffs to differentiate instruction in an 
efficient and effective manner. The multiunit school 
organization and the Instructional Programming Model are 
not universal prescriptions; instead they are 'mechanism^ 
to facilitate professional judgments. In fact, teacher and 
pupil activities should be different for different staffs 
ana pupils. It should be evident that variation is 
anticipated both in a school and between schools, and 
thus estimates of both within-school and between-school 
variances are important. The evaluation plan not only' 
includes estimates of the degree of ICE component 
implementation and of the level of pupil and staff 
outcomes, it also provides for estimates of the 
differential quality of instruction. 

In summary the ICE evaluation plan was conceived 
in light of the variety of educational evaluation activities 
of the past decade. We tried to incorporate some of the 
best ideas (like the combination of objective and sub- 
jective techniques), the most important variables (such 
as engaged learning time in the category of pupil activ- 
ities or degree of structuring in teacher activities) that 
other researchers have identified in the past few years. 
We tried to put the evaluation plan in at^ adequate 
framework. And, we attempted to use appropriate 
statistical techniques combined with subjective methods 
for examination and interpretation of the data. With this 
preparation, we were confident we could picture ICE in 
dll its complexity. 
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• THE EFFECTS 

• OF PLANNED CHANGE 



It is important for educators to consider systematic 
evaluation procedures fvt several reasons: The first and 
most important is i^ractir^aL The community we serve, legis- 
lators, and school boarc's are all demanding some form of 
accountability. In ,,05/ ft may have been enough for a 
principal when queried obout a new program to respond, "In 
my professional juc'gement. ..." Subjective judgments, no 
matter how valid, .;re no longer sufficient, ^'What*s your 
evidence?" is beinc asked. In part, this is because much 
recent educational chamje has been clouded by jargon, unsub- 
stantiated promises and panaceas, ill-defined goals, question- 
able implementation , and narrow evaluation. In addition, 
educators' credibility may have been weakened by the fact 
that some innovations could not be adequately evaluated 
because they never really happened in the classroom; such 
"changes" rarely affected the ways teachers actually planned 
and taught; and because no significant change occurred in 
what and how tcuct ers taught, many programs produced no 
significant differeme in student learning, A new, but only 
partially implemented program can rarely match a fully used 
program! 

Educational picnners and evaluators are confronted with 
c public skeptical of" both the value and the results of 
chatige, skeptical o,' the institution of public education which 
pretefids to be charging while remaining the same. Even 
more damaging for future educational improvement is that a 
segment of the public believes schools produce students who 
have t}een changed— changed so that they are less competent 
than previous generations. Thus, all educators need ta be 
able to present to others reasonable evidence about the 
effects of their planned changes. In Part 2 of this volume, 
live chapters summarize the evidence gathered in the IGE 
evaluation proiect. In chapter ^ we summarize the data 
conci-rning wf tether IGE "really happened" in schools. Then 
in chdpti^rs v.V a summary of the findings from each of the 
four phases ol the project is presented. 
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CHAPTER 4 



TO BE, OR NOT TO BE, IGE 

Thomas A, Romberg and Deborah M Stewart 

In 1976, the staff of the evaluation project knew that, 
although there were estimated to be nearly 3,000 elementary 
schools in the USA who called themselves ICE schools, there 
was considerable variation in the degree to which those 
schools had assimilated into practice the various features 
which characterize Individually Guided Education. The pur- 
pose of this chapter is to describe the extent of variation in 
ICE implementation at the start of the ICE evaluation study. 

DEGREE OF CHANGE IN SCHOOLS 

ICE should be viewed as an innovation which, if it were 
really implemented, would bring about changes in schooling 
practices. However, there are several difficulties in in- 
corporating any particular innovation into the culture of 
schools. The difficulty depends on many factors, ranging 
from the characteristics of the innovation itself to the 
structure of the culture affected by the change. McClelland 
(1968) discusses how effective implemefitation rnay involve 
different levels of cultural restructuring. The simplest level 
Is the substitution of one isolated component of the system for 
another, such as a change in textbook. If the simplest of 
changes causes further systematic alterations, such as the 
purchase of manipulative materials for the classroom, that is a 
higher level of change. The most complex of all changes 
deals with values, such as asking teachers to value an active 
classroom over a quiet one. This way of characterizing 
innovations focuses on the degree of restructuring that will 
be involved. 

Romberg and Price (1981) have labeled the poles of this 
dimension of change "ameliorative innovation" and "radical 
innovation." Ameliorative innovations are designed, or 
perceived as designed, to make some ongoing schooling 
practice better or more efficient but do not challenge the 
traditions associated with the school culture. For example, 
replacing the slide rule in engineering classes with the non- 
programmable calculator did not challenge how the knowledge 
of engineering is defined or how teachers are to work. 
Thus, it is an innovation that requires only ameliorative 
change. 
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At the othtjr extreme, radical innovations are designed 
and perceived as challenging the cultural traditions of 
schools. A modern biology text asks schools to define 
biological content differently; team teaching requires the 
development of new staff relationships. Obviously, as argued 
in chapter 2, ICE was designed with radical change in mind. 
It challenges basic assumptions of how schools operate, how 
knowledge is defined in schools, and how teachers and 
children function in elementary schools. 

The Wisconsin Center was well aware that ICE required 
substantial changes in the behaviors of persons involved in 
its implementation. So that school staffs would acquire the 
new behaviors, the changeover was approached in two ways: 
first, by developing implementation materials and, second, by 
providing opportunities for the school staff to acquire the 
understanding, skills, and avtitudes expected in their new 
and expanded roles. 

The materials that were developed described prototypes 
and guidelines for each of the seven components of ICE 
(Klausmeier, 1975). These materials were designed to assist 
staff members in understanding the concepts and practices of 
ICE, acquiring the needed skills, and making adaptations 
appropriate to local circumstances. 

To assist schools in making the changeover from the 
traditional, age-graded, self-contained elementary school to 
ICE, throe strategies were followed as a part of an overall 
implementation plan. The first and primary strategy was for 
the Center to train teams of implementors from other agencies-- 
state education agenc'es, teacher education institutions, and 
so forth— who in turn worked with schools through four 
implementation stages: awareness, first-year changeover, 
second-year maintenance and refinement, and institutionali- 
zation (Klausmeier, 1971). 

The second strategy was for a teacher education institu- 
tion to take the initiative in helping schools implement ICE. 
This strategy was made possible by the development of the 
Leadership Scries in ICE (Klausmeier, 1975). In this approach, 
a team of teacher educators plans a sequence of activities 
which includes conferences, courses, and seminars to help 
school administrators and teachers learn about and sub- 
sequently implement ICE. However, these materials were not 
tivcjilable before 1976, thus the effects of this strategy could 
not be examined in this study. 
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The third strdlegy was for an intermediate education 
agency, a teaching center, or a school district to provide ICE 
implementation assistance as part of an ongoing staff develop- 
ment program. This strategy was often used in school districts 
where there already were ICE schools and the commitment to 
ICE was strong. Persons knowledgeable about and experienced 
in ICE conducted the staff development activities. 

In addition, in 1969, an agreement was entered into 
between the Wisconsin Center and the Institute for Develop- 
ment of Educational Activities (/l/D/E/A/). /I/D/E/A/ then 
developed a set of ICE Change Program materials and prepared 
"facilitators" to start ICE schools. Because the /l/D/E/A/ 
approach to ICE differed somewhat from the Center's approach, 
mostly in what was emphasized, in 1972 the agreement between 
the institutions was terminated. /l/D/E/A/ saw ICE as an 
organization and set of procedures which would facilitate a 
harmonious learning-teaching environment. Thus, the emphasis 
was shifted from more effective cognitive instruction to a 
broader conception of the goals of schooling. By the time the 
agreement was terminated many schools had become ICE 
schools through /l/D/E/A/'s efforts. 

Since ICE elementary schools started in different ways, 
with the assistance of different persons and different agencies, 
and had been involved with ICE for differing number of 
years, it was reasonable to expect considerable variability in 
the commitment to the ideas underlying ICE and to its different 
components. In part, one purpose of the evaluation project 
was to document this variability and its effects. 

DEGREE OF IMPLEMENTATION 

The popukition with which this evaluation is concerned is 
constrained in several ways. The population is necessarily 
limited to those schools that define themselves as ICE schools. 
We believed there were about 3,000 such schools in 1975-76. 
In the fall of 1977, as data were being gathered for Phase I 
of the study, we had five sources of data about degree of 
irnplemcnttjtion of IGc, and a sixth source was to come later 
ds pari of Phase II of the study. Three sources of data came 
from a brief ICE Schools Questionnaire filied out by school 
administrators. This questionnaire was first sent to all ICE 
schools that had direct contact with the Center in Spring 1976 
(1,426 schools). The population studied by this evaluation is 
cofistrair^ed to include only those schools that responded fully 
to that questionnaire in March 1976. The questionnaire was 
btnt again to the schools in Spring 1977 and again to the 
actual Phase I sample in Fall 1977, 
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Two sources of Oata came from a second instrument, the 
ICE Implementation Survey (Stewart, 1977). This is composed 
of 77 statements or concepts defining ICE. Respondents were 
asked to rank their school's implementation of each ICE con- 
cept on a 5-point scale. In Spring 1977, we requested that 
the ICE school's governing body, usually the IIC, provide a 
concensus response. Then, in Fall 1977, as a part of Phase 
I, the same survey was answered independently by all school 
staff; the median response to each statement was used in 
analysis. Thus, results for both Spring and Fall 1977 were 
baced on one value per school for each statement. 

Finally, since both the ICE Schools Questionnaire and 
the Implementation Survey were self-report instruments, 
answers to questions from both were validated in Phase II of 
the evaluation. The Phase II sample was a subset of the 
Phase I sample and was rated by site visit teams. 

IGE SCHOOLS QUESTIONNAIRE 
1976 Spring Questionnaire 

Of the 1,426 ICE Schools Questionnaires sent out to 
principals of schools in 27 states, nearly' 74% (1,049) were 
returned before June 30. Zajano and Stewart (1976) des- 
cribed i\^e characteristics of the 946 schools whose principals 
considered them ICE schools; the first part of this section is 
based on that description. In developing the sampling plan 
tor Phase I, Price (1977) used the responses of the 768 
schools ttiat served both grades 2 and 5, those to be tested 
in the evalnation; the second part of this section is based on 
his aruUyvis. 

As sugcjebted above, principals were asked whether they 
considered l\uur school to be an ICE school. Just over 90^ of 
the respondents, 946, said they did. Of the remaining 103 
schools, nine reported never having been ICE schools, and 94 
reportecj no longer being ICE schools. Principals who said 
their schools were no longer ICE were asked to give their 
rciisons for droppirig the ICE program. The'r responses 
point out the importance of a common commitment to ICE from 
ail members of the local educational community. Lack of 
support at the school board/district level was reported to 
hijvu caused 17^. of the schools to leave ICE. Similarly, 16% o^ 
the scfiools al)andoried IGE due to lack of faculty support, 
and tinother 4?, cited the absence of administrative or 
community backing. Only 5% of these schools dropped ICE 
because of implementation problems. 
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For ddclitionril Inickground information, the question was 
a*-''' d, "With what agency did your school's involvement in 
ICib originate?" One-third of the 946 schools said the 
originating agency was the Wisconsin R&D Center, another 
29% said the Institute for Development of Educational 
Activities (/l/D/E/A/1, while 19% said both of these. The 
remainirig 19% responded by saying it was another agency or 
they didn't know or left the question unanswered. The next 
background question concerned the age levels or grade-level 
equivalents of pupils enrolled in each school. Although the 
K-6 grade range pattern was the most common (48%), there 
were 39 patterns represented. 

Tfie second set of questions on the ICE Schools Question- 
naire dealt with whether or not a school affiliated with any 
other ICE schools. This affiliation is possible either through 
an association of ICE schools in the same school system or 
with schools outside their system. Each principal was asked 
whetfier there wern any other ICE schools in their school 
system, nnd, if so, whether meetings were held with rep- 
resentatives from these schools and central office personnel; 
that is, did they belong to a Systemwide Program Committee 
ISF^CI, Tho next question asked whether schools affiliated 
with other ICE scfiools outside their school system in 
Networks, Leagues, or other such groups. Of the 685 
schools that answered both of these questions and have other 
schools in their systems, 92% maintained affiliations outside 
their own building regarding ICE. 

Tho third section of the questionnaire dealt with organ- 
i/r^tlon and instruction in ICE schools. Each principal was 
.isked to conpiete a chart for all Units or learning com~ 
nunities describing tho grade-range equivalei.i(s) , numbers 
{^f to.ichors and pupils, inclusion of special education pupils, 
whether tfiere were weekly planning meetings, and tfie ICE 
subjects used. From this information, the answers to several 
(|Ui»stior^s alxjiit tho organisation and instructior^ of pupils 
(.ouUi be derived. 

Tfu» first of these questions cortcornod tfic number of 
KjE \( hools in whicfi uH pupils wore orgariized into Units or 
kMrniruj commurMties, Of tfie 0^46 schools, 550 or 58o had 
unitized thc»r ontire pupil fjopulation. The percentage of ICE 
!5Cfu)o|j wit^-i pupils of different ayes in each Unit or learning 
(onnajnity w.)-. .ilso determined. Of tfie 946 scfiools, 711 or 
/') li.nl .ill Uriits niulticKjed. Afi addition<il 133 or Wl? fiad 
s(jrT\o of their Units r-^ultiayed, wfiile 55 or 6.. had no multi- 
plied UnitJ, 
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The combination of these findings was of primary inter- 
est; that is, of schools that had all their pupils in Units, how 
many had all nultiaged Units? Of the 550 schools with all 
pupils in Units, 415 had all Units multiaged. This is 75% of 
the 550 fully unitized schools and 44% of the total 946 ICE 
schools. 

Since the primary reason for organizing students into 
multiaged Units is to provide for instruction based on indi- 
vidual needs, schools were asked to list by Unit their ICE 
subject(s). An ICE subject was defined as "one in which 
teachers follow the whole sequence of identifying objectives 
for the students in their Unit, preassessing for those ob- 
jectives, then grouping students according to which objectives 
they need to master, instructing on those objectives, then 
testing agdin and regrouping," that is, the sequence of the 
Instructional Programming Model (I^M). 

The responses of the 550 fully unitized schools were 
tnbuiated to determine which schools use the IPM in the same 
subject(s) in all Units, thereby providing the fullest oppor- 
tunity for continuous progress in that subject for their 
pupils. (For the purposes of discussion, a subject used in 
this fashion will be termed an IPM subject.) Of the 550 
schools, 437 or 80% had at least one IPM subject. Many of 
these schools were providing for continuous progress in more 
than one subject area. The most common number of IPM 
subjects was two, reported in 32% of the schools, but the 
range extended froni zero to six. A disappointing finding 
was that 96 schools (17%) did not use the 1PM in even one 
subject area that was the same for all their Units. 

The subject areas most often selected for 1PM imple- 
mentation in the fully unitized schools were identified. 
Reading was the most commonly selected subject, chosen by 
two-thirds of these schools; and math was a very close 
second. In the fully unitized schools implementing the 1PM in 
only one subject area, reading was again the most popular 
choice (64%) while math was considerably further behind 
(27%), 

It was hoped tfiat the questionnaire would reveal some 
examples of typical Unit structures; however, so many alter- 
native arrangements of pupils in Units were reported that 
none Wtis representative. For example, the 159 K-6 schools 
witfi ciM pupils in rnultiageci Units included from one to seven 
Units in 52 different arrangements. 




Aiiother topic of interest was the operating charac- 
teristics of the staffs of ICE schools. Schools w<»re asked 
whether they had the following features: weekly planning 
meetings for Unit members, release time, Unit leaders, an 
Instructional Improvement Committee for schoolwide govern- 
ance, aides, and interns or student teachers. 

Eighty-four percent of the 946 schools responded that all 
their Urnts had weekly planning meetings, 6% said some of 
their Units did, another 6% said none of their Units \ i these 
meetings. The results for a related question indicate^, that in 
690 schools, 73%, release time was provided so that Unit staff 
members could plan together during the school day. Slightly 
more than two-thirds of the schools that had release time 
provided two or more hours of it each week. 

The question of whether all Units had Unit leaders 
received a positive response from 92% (869) of the 946 
schools. A related question concerned whether it was the 
school's policy to rotate the Unit leader position. Twenty-six 
percent replied that it was, while 68% said it was not. 

The question of whether each ICE school had an Instruc- 
tional Improvement Committee (IIC) comprised of the principal 
and Unit leaders received a positive response from 871 or 92% 
of the 946 schools. To the quostion of how frequently this 
group met, by far the most common reply was "once a week." 

A common feature of ICE schools is the use of either 
paid or volunteer aides or both. Of the 922 schools who 
responded to both questions concerning the use of aides, 893 
or 97^, use aides to some extent. Sixty-fivj percent of the 
922 schools had both paid and volunteer aides, while 23% used 
only paid aides and 9% used only volunteer aides. 

Another common feature of ICE schools is their partici- 
pation in preservice teacher education. A total of 927 schools 
reported whether they had student teachers or interns during 
both spring 1976 and fall 1975. At some point during the 
previous school year, 687 schools, or 74% of 927, had partici- 
pated ir^ preservice teacher education. This percentage is 
remarkable when the availability of teacher education institu- 
tions is considered, ^he results suggest that ICE schools 
were welcoming available student teachers into their building 
and thereby providing valuable preservice preparation in ICE. 

The final section of the questionraire dealt with the 
curriculum products component of ICE. The schools were 
asked to indicate whether they were using any of the 
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WibCunbiri R h [) C<fnt(^r's curric:ulum products. Over 50% of 
the schools wore usifuj ofic or more elements of the Wisconsin 
Design for Reading Skill Development (WDRSD). Thirty-three 
percent were using one or more of the hidividually Guided 
Motivation (ICM) procedures* Eleven percent of ihe 946 
schools used Pre-Reading Skills (PRS); this figure is more 
metuiingfully presented as 14% of tfie 752 schools who have 
kinderg^irten pupils. Finally, Developing Mathematical Pro- 
cesses (DMP) was used by II?, of the 946 ICE schools. 

This overall information about ICE schools was what was 
available to the staff of the evaluation project in Fall 1976. 
Obviously, tfiere was considerable variability in ICE charac- 
teristics among tfie reporting schools. We considered this 
good for two reasons--one is statistical, the other social. 
Statistically, cin accurate assessment of relationships among 
variables requires that the sample not be of restricted range 
with respect to its parent population; restriction of range on 
<niy vciriable produces a sample estimate of relation that is 
wtMker than the corresponding parameter in the population. 
Socially, it is important that certain subpopulations be 
adequately represented— both as parts of the general popula- 
tion drul separately identifiable populations of special 
interest; for oxdniple, schools in low-income neighborhoods, 
particularly urban neighborhoods, nay be more important and 
deserve greater attention than their proportion of ICE schools 
would sufjfjest. 

From these considerations, a subpopulation of schools 
that served both second and fifth graders was used as the 
base population for the evaluation. These 768 schools are 
abuut uf the estimated total number of ICE schools. We 
(iid not assume that these schools were representative of ICE 
schools. Rather we assumed this population would be posi- 
tively biased toward ICE and exhibit more of the ICE charac- 
teristics en the average tlian the unidentified ICE schools. 
Tfiose otfier scf^ools cither were riot on current mailing lists, 
suggesting that tfiey were new to or riot active in ICE 
cinles, or failed to respond to tfie questionnaire, suggesting 
Lick of irueresl. 

StrcJtification Vcjriablcs were created from the ICE Schools 
Questionnaire responses to provide tfie basis for Phase I 
sampling. The four variables related directly to ICE charac- 
tcristi ^ cire staff organization, use of {he \PM, student 
f^r(j»Hn. ,ition , iirul facilitative environments. 
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Four queslioruwiire items were used in creating the staff 
organization variable* Responses to each item were assigned 
values from 0 to 2 , and the four values were summed for a 
possible maximum value of 8. The following four organiza- 
tional characteristics are expressed in the 2-point version: 
first, weekly planning meetings for Unit staff; second, at 
least two hours release time each week; third. Unit leaders 
for all Units who were not, by policy, rotated out of position 
on a regular basis; and fourth, weekly meetings of the princi 
pal and Unit leaders. For the fourth item, I point was 
assigned for meetings every other week; there was no inter- 
mediate value for th:; other three items. The distribution of 
school values for staff organization is shown in Figure 4-1. 
We considered a composite rating of 6 minimal for ICE staff 
organization; 480 schools, 63%, had composites of 6 or more. 




Fiqure 4-1. Kcitinq of staff organization (Adapted from Price, 
nU7. p. lb). No rating for 37 sch()v;ls. 



63 



Use of thij IPM w«s a composite variable based on 
whether each of six curriculum areas—reading, mathematics, 
science, social studies, music or art or physical education, 
and language arts—was an IPM subject. Reading and mathe- 
matics were weighted more heavily than the other areas. In 
144 schools, 19%, there was no IPM subject. In contrast, 139 
schools, 18%, had reading, mati>ematics, and one or more 
other areas as IPM subjects. 

The rating for tacllitative environments was based on 
three pieces of information. First, whether the school was 
part of a communication network larger than the district to 
which the school belongs; second, whether there were other 
ICE schools in the district; and third v,hether the school 
reported communication with other ICE schools in the same 
district. Responses to each of these three questions were 
clascified dichotomously. Although 85 schools, 11%, reported 
no con.mun.catiori with other ICE schools and an additional 120 
schools, i6%, had no communication network outside the dis- 
trict, over half of the schools reported full participation in 
communication networks, 274 or 36% both within and outside 
tfie district and 146 or 19% outside a district with no other ICE 



A rating of the organization of students was developed 
from a composite of three items concerned with how children 
are organized in a multiunit school. For each item a maximum 
value of 3 and minimum of I was assigned to various re- 
sponses; points were summed for the composite rating. The 
first constituent is based on the assumption that an I & R 
Unit can have too few children or too many; Units of from 100 
to 125 children were considered of optimal si^e and those of 
75-99 and 126-150 workable. The second is a rating of the 
extent to which all children in a school have been included in 
the I 8 R Unit arrangement. The third variable reflects 
whether all, some, or none of the Units are multiaged. Only 
lO^f^ of the schools reported optimal ICE organization of chil- 
dren. An additional 241 schools, 31%, reported groupings that 
are workable. 

In summary, responses to the 197b ICE Schools Question- 
naire indicated that ICE implementation was incomplete in 
many schools. The label ICE was obviously used to describe 
many schools that as yet had not implemented key ICE fea- 
tures; these we have called Nominal ICE schools. There were 

n<)ny schools who had fully implemented only some of the 
ICE features. And finally, there were some schools ti'.at 
could actually be called ICE in that t'»'iy reported tiiat they 
had implemented al! major ICE featui^s. 



schools. 
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Follow-Up Information 



To check both the stability of ICE implementation and 
the validity of the reported information, there were three 
additional sources of data. In Spring 1977, when the Phase I 
sample was being selected, 482 schools filled out the ICE 
Schools Questionnaire a second time. Then in Fall 1977, as a 
part of Phase I data gathering procedures, participating 
schools completed the questionnaire again. In both Spring 
and Fall 197/, schools were asked to update their previous 
reports, rather than to fill in a blank questionnaire. 

Both 1977 samples were similar to the 1976 sample, and 
the data reflected near zerj change in degree of implemen- 
tation. The differences reflected changir^g social and eco- 
nomic conditions nationally. Dramatic size changes were 
reportea by 30^ of the schools: 38 schools lost over 100 
students from 1976 to 1977, with 13 losing over 300; and 32 
gained over 100 students in the same period, with 9 gaining 
over 300. Both losses and gains were due to overall lower 
school enrollments which caused some school closings and 
quite often restructuring of schools and Units within schools. 
In addition, there were many anecdotal comments about failure 
to implement other ICE features because of restricted budgets 
which limited staff development opportunities, purchase of 
ICE--compatible materials, and so forth. 

Finally, in Phase II, the Research Triangle Institute 
visit teams took the ICE Schools Questionnaire to each of the 
30 schools they visited during the spring of 1978. Their task 
was to validate the information provided in October 1977, the 
date of Phase I testing. The value of the Phase II validation 
data IS not so much in the actual information reported as in 
the frequency with which particular items were corrected 
across scf-iools and the total number of changes in given 
schools. Both kinds of alterations in ICE status were ob- 
tained in face-tO'face contact with school personnel, primarily 
principals, in the to*al Phase M sample. These alterations 
intimate the nature and extent of such changes that might be 
expected in the parent Phase I population, although there is 
no htisib for predicting frequencies that might emerge in the 
total samf)le. 

Overall the validation task resulted in a great deal more 
ddtvi verification than data alteration or correction. F^tries 
made prior to Phase II work in the field were found to be 
correct in from 25 to 30 schools for most items in the instru- 
ment, ir^cluding historical data, staffing patterns, and extra- 
school ossocititions. 
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Across M\ s(ho()lb, no item escaped some sort of change 
or correction, and certain items required a significant amount 
of attention. For example, status as an ICE school was 
changed in one~fifth cf the schools; the fact or amount of 
release time for Unit planning was corrected in almost one- 
third of the sample; and in two-thirds of the schools, 
designation of ICE subjects was altered. In all of these 
cases, the change was essentially negative: the number of 
ICE schools was reduced to 20 from 26; release time was 
provided in 22 rather than 25 schools and a number of 
schools indicated reduced time allotments; and from I to 7 ICE 
subjects were eliminated in each of 18 schools, while ICE 
subject designations were added in only 4 schools. 

In conclusion, the picture of limited ICE implementation 
derived from the ICE Schools Questionnaire appears to be a 
rose-tirited picture of the overall impact in the sample of 
schools claiming to be ICE. 



IGE IMPLEMENTATION SURVEY 

As this questionnaire was originally conceived, it would 
provide results to be used within a school to plan for 
refinement and renewal of the school's program. On two 
occasions, as described below, the Center distributed the 
questionnaire tc obtain more information about the level of 
ICE implementation nationally. The questionnaire consists of 
77 statements describing ICE outcomes, organizational matters, 
and processes. The statements were presented in seven 
groups, one for each of the components of IGE: Multiunit- 
brganizational Administrative Arrangements (MUS), Instruc- 
tional Programming for the Individual Student ('PM), 
Curricular Programs (CURR), Evaluation for Decision Making 
(EVAL), Home-School-Community Relations (HSC), Facilitative 
Environments (ENV), and Continuing Research and Develop- 
ment (K & D). The statements to be judged in large part 
reflect tfie published list of performance objectives for IGE 
(ICE Staff Development Project, 1976). The following state- 
ments are two of the 18 in the MUS section of the question- 
rwiire : 

- the entire organizational staff and the students are 
orgar^ized into I I R Units. 

■ LACh tc.icher of ihc I & R Unit participates in the Unit 
meetirujs and the related planning and decision making. 
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f-or each btutomenl, respondents rate their school using a 
5-point scale ranging from no implementation (0), through 
adequate implementation (2), to ideal implementation (U), 

Raw scores were obtained by summing the values 
assigned to tlie statements for each subscale jnd the total. 
These scores were considered difficult to interpret because 
subscores were based on differing numbers of statements. 
The raw scores were divided by maximum possible score to 
obtain a percentage implementation score for each subscale 
and the total. To categorize percentage implementation 
scores, we define those from 75% to 100% as indicating iCE 
schools, those from 50% up to 75% as indicating schools 
marginally ICE, and those below 50% as indicating schools ICE 
in name '^nly. 



In Spring 1977 a single school response was requested of 
the lie in each building. Completed forms were returned 
from 37i4 schools. The mean percent implementation scores for 
these schools for all seven ICE components are shown in 
Table 4-1, On the average, schools were marginally ICE* 



The ICE Implementation Survey was included in the 
Ceneral Staff Questionnaires to be filled out by each pro- 
fessional staff member in the Phase I schools. Thus, insiead 
of a single response from a school, we received several. 
Average stores were calculated first for each school. To get 
an average school score for MUS, for example, the ratings of 
all staff for the 18 questions were added together and then 
divided by the number of staff responding. Using this 
average score, the percentage implementcition score was then 
calculated. The average percentage impknentation scores for 
these schools for the seven ICE components, shown in Table 
4-2, are from 7 to 10 percentage points lower than scores had 
been in Spring 1977. The aifference was not due to idio- 
syncratic re*^^unses by on'v a few staff members, since school 
medians were almost identical to school means. In many 
schools, there was considerable within school variability. An 
examination of individi'al school data revealed that the prin- 
cipal and other IIC members consistently reported higher 
implementation ratings than other staff. The responses from 
thrue schools to items 24 and 32, shown in Table 4-3, illus- 
trate the typical variability in response frequencies. This 
variability indicates that starf members in many schools have c 



Spring 1977 Results 



Fall 197/ Results 
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Spring 1 977 PurccMiUjge Implementation Scores 
from the ICE Implementation Survey 
iN.i7i* schools, one r^-ponse p(-» school) 



ComponBtit 


No. items 


Mean 


sd 


1. MUS 


18 






2. IPM 


14 


64.71 


16.01 


3» Curric 


8 


70.77 


16.02 


4. Eval 


9 


61.22 


17.60 


5. HSC Rol 


9 


57.76 


15.54 


6 • FacEnv 


15 


52.58 


16.68 


7. R&D 


4 


56.07 


18.87 


All concepts 


77 


60.77 


12.50 



considerably different notions about ICE components and how 
well their school is implementing them. Some hiyh responses 
may be due to wishful thinking, believing implementation is 
better than it really is, and some low responses may be due 
to upfamiliarity with the ICE terminology, not recognizing the 
label for a feature that has been implemented. 

In summary, in many sc'hools some staff judged that the 
ICE program was implemented only slightly in their school. 
In no case did staff judge the ICE program to be fully imple- 
mented in their school. Naturally, scores for each school 
varied among components, refi'ecting the varying priorities 
estoblished for implementation of the components and varying 
strengths of the school. 

f-ollow-up data were also gathered on eleven Items from 
this questionnaire in the Phase II study. This followup was 
conducted not only to estimate the validity of these imple- 
mentation data but also to identify reasons for disparate 
ratings in a school. In each of the 30 schools, observers 
gave ratings for each of the eleven items, a total of 330 
independent ratings (see chapter 6). A comparison of dif- 
ferences in the staff ratines from Phase I and the inde- 
pendent Phase II ratings sliowed that 39% of the rating 
differences were essentially zero. However, of the nonzero 
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Table n-2 

Phase I Percentage Implementation Scores from the 
ICE Implementation Survey 
(159 schools, multiple responses per s hool) 



No. of Lowest Highest 

Component Items Mean sd Score Score 



1. MUS 


18 


55.8 


14.3 


14.2 


96.3 


2. IPM 


14 


57.8 


13.9 


10.2 


96.8 


3. Currlc 


8 


62.8 


13.3 


27.5 


99.0 


4. Eval 


9 


55.3 


14.6 


18.9 


93.7 


5. HSC Rel 


9 


49.7 


13.4 


17.3 


93.2 


6. FacEnv 


15 


45.2 


15.9 


9.2 


93.7 


7. R&D 


4 


47.9 


15.8 


7.8 


94.9 


Total 


77 


53.6 


12.8 


18.5 


92.7 



NOTE; The number of schools from which complete responses to the 
Implementation Survey were received differs from the number 
with complete responses to the IGE Schools Questionnaire and 
to each of the other Phase I instruments. 



Table ^-3 

Frequency of Staff Responses in Three Schools 
on Items 2** and 32 



Response 


161 


Srhnnl 

571 


624 


Item 24: 


Each I & R Unit functions 


effectively. 




0 


0 


0 


0 


I 


1 


0 


7 


2 


I 


9 


10 


3 


6 


14 


4 


4 


5 


4 


0 



Item j2: The IIC functions effectively to coordinate the educa- 
tional program of the school and its program of staff 
development, home-school-coramunity relations, research 
and development, and external relations, taking into 
account district and state requirements and the needs 
and objuctivea of each I & R Unit, 



0 


0 


0 


0 


1 


4 


1 


4 


2 


2 


6 


13 


3 


2 


13 


4 


4 


5 


7 


0 



differences, two-tiiirds resulted from higher ratings by school 
staff, and one-third from higher ratings by the Phase II visit 
teams. Reasons for lack of staff convergence (Table 4-3) 
were multiple, even at a single school. School staffs often 
responded on the basis of something less than the whole 
school, had some difficulty with various aspects of the items 
themselves, worked with their own sets rather than as the 
directions asked, or made guesses and estimates. A large 
proportion of the obtained reasons reflected some special 
response bias such as the individual Unit or the previous 
year's status. In all, these results suggest, as was the case 
for the ICE Schools Questionnaire, tfiat data about 
implementation of the seven ICE components are positively 
biased. 
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IN CONCLUSION 



Lat us now return to the question of how many schools 
who call themselves ICE could reasonably be considered to 
have implemented its components. We consider the Phase I 
Implementation Survey data to be the most valid, although 
clearly positively biased. Rather than working with all seven 
ICE components separately, we collapsed them into three 
clusters— the muitiunit school (1), the instructional program 
(2, 3, and 4), and renewal (5, 6, and 7), Average implemen- 
tation scores for the 159 schools were categorized to indicate 
actual, marginal, and nominal ICE schools, as described 
previously, with the marginal category split into high (62.5 - 
74.9%) and low (50 - 62.4%). The number of schools that fit 
in each category is shown in Table 4-4. In terms of total 
implementation score, there are very few actual ICE schools, 
only 5, and not many high marginal schools. 32. Many low 
ratings on total score are due to low implementation of the 
renewal components--home-school relations, facilitative 
environmerits, and research and development. Since these 
components naturally would come later in an implementation 
cycle than the other components, we decided to focus on 



Table 4-4 

Number of Phase I Schools Categorized by Level of 
Implementation for MUS. Instruction. Renewal and Total 

(N^159) 

Luvfl of MUS Instruction Renewal Total 

Implemuntation (1) (2,3,4) (5,6,7) 

Actjal 13 13 5 5 

(75;. to loo;:;) 

High Marginal 37 45 17 32 

{bi.yA ic 74 .9;o 

Low >Liriiinal 67 45 62 

Nominal ti5 34 92 60 

(less r.han 30/0 



ERIC 



71 



bcores from the first tvvo clusters. A crosstabulation of 
schools which fit into each cluster for MUS and for 
Instruction is shown in Table 4--5. From this tabulation, we 
Identified any school which is at least high marginal on both. 
MUS and Instruction as an actual ICE school; there are 38 
such schools, 24% of the Phase I population, that fit this 
description. Next, schools which were at least high marginal 
on one aspect and low marginal on the other we have decided 
to call marginal ICE schools; there are 30 such schools, 19% of 
the Phase I population. The remaining 91 schools, 57% must 
be called nominal ICE schools. 

The number of each category of school participating in 
each of the four phases of the ICE Evaluation is shown In 
Table 4-6. Nearly one-quarter of the schools who call 
themselves ICE were really working at reorganizing their 
staffs by forming Units, sharing decision making, and 
attempting to change the pattern of instruction in their 
schools. Another 20% were heading in the same direction but 
encountered problems in forming Units, or setting objectives, 
and so forth; they were not yet ICE but they are no longer a 
conventional school. Finally, there were the majority, some 
60%, who ostensibly liked some of the ideas about ICE and 
who wanted to be identified with the concepts but who as yet 
had not made the fundamental organizational and instructional 
changes which reflect Individually Guided Education. 



Table 4-5 

Number of Phase I Schools by Level of 
Implementation for both MUS and Instruction 



MUS 



Instruction 

Actual High ^larginal Low Marginal Nominal 



Actual 

High Marginal 
Low Marginal 
Nominal 



r 



1 
I 

L ^ 
1 



0 



J 



1 

11 



17 



32 
23 



0 
0 
4 



.11 tual l(iL schools 
nominal ICiK schools 



n 



Si 



Table 



iCE 


Implementation 


Storei 


or Schools 


in 








Phases 1, II, 111, 


and IV 








Implementation 


I 


II 


III 




IVCa 


Categoty 






N, % 


N. 




N St. 


Actual JGE 






2, 33 


1. 


i4 


4, 2i 


Marginal IGE 


28, 18 


5, 17 


3, 50 


1. 


14 




Nominal IGE 


94, 60 


15, 50 




3, 


43 


0 7 7 


Non-IGE 












7, i7 


Unknown IGE^ 






1, i7 


2. 


29 


6, J2 


Total 


159 


30 


6 


7 




19 



Note: Percentages may not suid to 100 due to rounding. 

*^hase IV had two parts: a descriptive set of studies (D) and 
two comparative studies (C) . 



Because these TGE schools did not participate in Phase I, we do 
not have results of the Implementation Survey and cannot specify 
level of IGE implementation with confidence. 
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Certain features of ICE schooling were assumed to be 
keys to the program's success. Phase I of the ICE evaluation 
project examined variations in the extent to which these 
presumably essential features had been implemented among 
ICE school, and assessed how influential such variations in 
implementation were on the reading and mathematics achieve- 
ment of second- and fifth-grade students and on teacher 
job-satisfaction. 

Purposes 

The overall purpose of Phase I, as with the other ICE 
evaluation phases, was to gain a more comprehensive view of 
the operation and effecti eness of ICE. The basic objective 
was to identify features of ICE schooling that contribute to 
successful instruction, especially in reading anr' mathematics. 
The identification of such features was assumed to be critical 
to evaluating ICE as an educational system and to understand- 
ing schooling in general. 

The specific purposes, as described in chapter 3, were: 

1. to describe and examine the relationship between the 
implementation of ICE components and moons of instruction , 
particularly in reading and mathematics; 

2. to describe and examine the relatiorishlD between the 
impiementatnn of ICE components and staft outcomes; and 

3. to describe and examine the relationship — presumably by 
way of the means of instruction--between the implementation 
of ICE components and pupH outcomes, such as reading and 
matficmatics achievement, selected cognitive skills, and 
aspects of personality development. 



This cfiapter is a condensation of the Phase I summary 
report by Cary G. Price, Thomas A. Romberg, and Terence 
C. Janicki {1981). 
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Simple compcirisons between ICE as an undifferentiated 
package and other educational alternatives provide us with 
little information about specific features and processes that 
occur in ICE schools. Thfefore, Phase I simultaneously 
examined relationships ar.ong the network of variables be- 
lieved to influence means of instruction, staff outcomes, a 'H 
pupil outcomes. 

The Phase I study was not designed as a direct compar- 
ison between ICE schools and other schools. Instead, it was 
an assessment of certain fundamental and empirically testable 
premises on which ICE is based. As its developers intended, 
ICE was not an isolated innovation but a complete system built 
upon theoretical positions about the goals of education, the 
effects of certain forms of instruction, the effects of school 
organization on instruction, and the effects of linkages that 
go beyond the walls of the school building. 

Premises 

Some of the premises on which ICE is based are explicit. 
Others are implicit, but evident. Three general kinds of 
premises were recognized in the Phase I study. 

Premises about instructional programming assert that 
instructional practices associated with the Instructional Pro- 
gramming Model make high student ach'evement more likely 
(Klausneier, Karges, & Krupa, 1977, pp. 333-334). Two instruc- 
lior^al practices and their reputed influence on student achieve- 
ment are included. The first practice is characterized by a 
variable named Management of Grouping and Instructional Con- 
tinuity (IE); the second by a variable named Individualization 
of Instructional Decisions (IDM). These variables and others 
wei "Cdled from information drawn from several questionnaires 
ireait- i as one large pool o\ potentially relevant items. 

The ICE niodel suggests that the organization of class-- 
room instruction should have an effect on student achieve- 
ment. The Instructional Programming Model (IPM) is used tc 
(jroup students according lo their individual needs, niakir»g 
teacher btuderU instructional interactions more effective. 
IE measures several facets of the classroom instructional 
environment ar^d should, according to the ICE model, be 
directly related to student learning. 
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IDM f.iedsufiJb tfiu c.'xtunt to which instructional decisions 
take into account the individual needs of the student. Tak- 
ing individual student needs into account is the cornerstone 
uf the ICE model, and it is supposed to be related to student 
achievement. 

The postulated causal links between these variables and 
measures of student achievement are shown in Figure 5-1 . 
The figure expresses an ICE theory of the causal relation- 
ships among the variables. 

Student achievement n reading and mathematics is the 
dependent variable in Figure 5-1. Another dependent vari- 
able is Teacfier's Job Satisfaction (JOBSAT). It has been left 
out of Figure 5-1 for visual simplicity. 

Premises about information materials, and so on, a'osert 
that certain systems of record keeping and information col- 
lection maka it more likely that the instructionti! practices of 
[ha Instruction. il Programming Model will occur. Likewise, the 
use of curriculum materials that lend themselves to record 
keepincj, information collection, and segmentation of curric- 
ulum units make those instructional practices more likely to 
occur. Four variables are concerned with these premises. 
One of those variables. Individualization of Instructional 
Decisior^s (IDM), has already beer^ mentioned. The second is 
the U<»e of a Variety of Curriculum Resources (UCR), and the 
third is the Schoolwide Implementation of the Instructional 
Progr^imming Model {SIPM). Schoolwide implementation is 
importc'-nt because presumably, the instr -.ctional practices of 
the individual I & R Units resonate with the practices else- 
where in the school. 

The IGEz* model suggests that the amount and variety of 
student information available should directly influence the 
individualization of instructional decisions. The amount and 
variety of student information avaiiabk is reflected by the 
variable Information Acquisition (lA). The model also sug- 
gests that schoolwide implementation of the IPM should pro- 
mote such individualization. The procedures needed for 
efficient dnd useful information acquisition are presumably 
li.Tiited by incomplete schoolwide iniplenientation of the IPM. 

Premises about supportive arrangements assert that 
certair. ciistinctively ICE features of school organization make 
use ()[ ln*-tr..cti()ntil Programming Model (IPM) more likely. 
Tfioso orgjni/ationdl features diso make it more likely that the 
staff will be satisfied with their jobs. 
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FivTure 5-1 



Cau^*-! model of relationships implied in IGE 
literature. . 

BEST COPY AvAiL/u.'. 



Two (jrcjiini/iitioniil features in particular have been 
presented in the IGE literature as ones which create an 
organizational environment conducive to use of the IPM. The 
first of these is an assort nent of activities collectively 
labeled and measured as Procedures Fostering Coordination 
tind Improvement of the School Program (COS). The second, 
reflected by the variable I ntraorganization-* Structure (IOS\ 
lb a collection of structural arrangements distinctive to ^CE 
schools, such as organization into^ I 6 R Units, existence of 
an Instructional Improvement Committee, and so forth. 

The effect of organizational features on schoolwide 
implementation of the iPM would be difficult to assess if 
teachers' backgrounds and beliefs were not considered, too. 
Two appr )priate staff measures are included* The first, 
General Staff Background (CSB), is an aggregate measure of 
how much ICE-related experience teachers have. The second. 
Belief in Individual Differences (INDIV), is a measure nf how 
stroncjly and unanimous>y the teachers of a school endorsed a 
hcisic. cibsurnptiun of ICE--the assumption that students differ 
in wtiys that instruction ought to take into account. 

One distinctive organizational feature of ICE is the 
system of linkages between ICE schools. One intended con- 
boquonce of such Interorgani/ itional Relations (lOR) Is the 
exchange of information aLout i f^M-compatible curriculum 
materials and other cui. iculum resources. Contact with other 
schools would presumably help teachers to use a variety of 
curriculum materials. The variety of curriculum materials 
used by an I 6 R Unit would depend partly on other prac- 
tices of the Unit, too. For instance, I & R Units that gather 
and orgunize information about students, through their efforts 
to individualize instructional decisions, would be more likely 
to use a variety of curriculum naiierials. 



The fundamental premises have been represented as a 
notwork of postulated causal links among the variables of the 
study. Fiv.^..re 5-1 presents these causal links in dUigram 
forni. It shows the paths of influence assumed to underlie 
the relationships between reading acfiievement and the other 
variables studied. The figure expresses an ICE theory of 
how each variable is causally related to the other variables. 

I ho fli.iso 1 study evaluated tfiese premises by empir- 
iCtilly cissossintj the relationships they imply, Th's approach 
to evaluation would not be feasiL*"^ if ICE schools had 
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uniforriily implorMrnUiU thu or(jcjni;?atiorvi. features, curriculum 
features, and instructioruil practices suggested by experts in 
ICE. Such uniformity, however, did not exist, aS described 
in the previous chapter. 

Each arrow shown in Figure 5-1 signifies a causal link 
assumed in the ICE system. Not every causal link assumed in 
IGE is indicated, only some of the major causal assertions 
implicit in ICE. The intent was not tu ask whether IGE 
works. Ratf^er, the intent was to ask whether ICE works in 
the way its developers thought it would. 

The diagram is known as a structural model or causal 
model and follows certain grapfiic conventions. According to 
these conventions, a straight, unidirectional arrow signifies 
that the variable at its base directly irifluences the variable 
at its tip. The omission of an arrow constitutes an explicit 
theoretical statement that no direct causal relationship exists. 
A varial)le is an indirect cause of a dependent variable if a 
path throuyfi two or more arrows can be traced from the 
de[)end(rnt variable back to the firsl variable. Associated 
with each straight arrow is a nonzero value. The sign of the 
value (Jcnutes whether an increase in the causal variable 
produces an increase (plus) or a decrease (minus) in the 
dependent variable. A curved, bidirectional arrow is used at 
the left of the figure between variables which are known to 
be correlated, but for reasons not covered in the scope of 
the model. 

A system of structural equations corresponds to the 
model. These equations were statistically examined for their 
agreement with the data collected in the Phase 1 study. 
Within the limits imposed l)y measurement error in Ihe group- 
adrTiinlsterecJ, standardized tests and questionna .jsed to 
collect the data, th«s approcch tests tho theoret lodel that 
underlies ICE. If the relationships between vari. ^es are not 
consistent with Figure 5-1, then piobable inaccu.^jies in the 
uriderlylng ICE .nodel would be revealed. On the positive 
side, this approach can indicate important features and pro- 
( essos wliic^ deserve more attention ft jm schools implementir^g 
IGE. In tf^ib context, "importance" means that a feature or 
process influences outcomes that are socially valued. 
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METHODS 
Sampling 

'^nc population with which this evaluation was concerned 
was constrained in several . ways. The population was neces- 
sarily limited to tho e schools that identified themselves as 
!GE schools. The population studied by this evaluation was 
further constrained to include only those schools that re- 
sponded full/ to the ICE schools questionnaire of March 1976 
I see chapler 4 for details). There were 946 such schools, 
768 of which had both second- and fifth-grade students, The 
evaluation was limited to students at the ICE equivalent of 
second and fifth grades, and their teachers. This population 
(;f 768 ICE schools is nationwide; it includes urban areas, 
rural areas, low-"income areas, and high-income areas, 

A sample was sought in light of the planned analysis. 
To select the sample of 300 schools, a plan of sl'^atified 
random sampling was followed. Information from the March 
1976 IGL Schools Questionnaire was used to construct seven 
stratification variables: (1) rating the staff organization, 
(2 J age of the program, (3) utilization of the Instructional 
Programming Model, (4) rating for facilitative environment, 

(5) rating of the organization of children In the school, 

(6) use of Center curriculum products, and (7) demographic 
information. These seven vaii.bles were then used to 
classify the population into strata, and 302 schools were 
selected randomly. The sample on which the evaluation was 
ultimately based, however, was not this initially drawn 
sample. Only 175 schools agreed to participate in the 
evtiluation. There was consequently a danger that self- 
selection had created a sample that differed significantly from 
the population in terms of the ICE characteristics with which 
the evalu.'^tion is concerned. The sampling frame, however, 
provided a means of assessing whether and how the partici- 
p<in» schools differ fron the population. Remarkably, the 
self-selected sample was very similar to the population in 
lerns of the stratification variables. For a more detailed 
.icc.ount tjf tho samfji.ny procedure see Working Paper No. 223 
(Pricr, 1977). 

Instruments 

Instrumentation for Phase I included self-report 
(^u(?stit)nri<nri»s for staff and standardized tests of academic 
jf)titu(ie, standardi/ed achievement tests, and personality 
dovelopmera scales for students. In addition, cognitive 
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dbiiity t(?stb, devei(j|)ffi »)t the Center, were administered to 
the graae 5 students. More detail about Phase I data gather- 
ing has been provided by Klopp, Buchanan, Stewart, and 
Romberg (1979). 

Questior)naires for the staff component of the evaluatii. n 
were based primarily on several existing instruments which 
were modified in ^.ontent or forniat to meet the requirements 
of ICE terminology and certain technical constraints, such as 
machine-readable response forms. A discussion of the content 
and source of each instrument appears in Stewart (1977). 
l imited in Table 5-1 are the instruments uspd in the study and 
the staff members who responded. The variables actually 
used in the Phase 1 analysis typically drew information from 
several of the instruments. Consequently, scores were riOt 
developed for instruments. An overview of the variables from 
staff questionnaires may be found in Price, Janicki, Howard, 
Stewart, Buchanan, and Romberg (1978). 

Sludrntb were tested at grade 2 and grade 5. Listed in 
T<ible b-2 are the tests administered at both grades. Copies 
of the Short Form Test of Academic Aptitude (SFTAA ) , 
Califurr.ici Tf-st (jf Basic Skills (CTBS), and Self-Observation 
Scdieb (SOS) were purchased from ccmmercidl publishers. 
The f ive Concept Att<nnrrient Abilities (CAA) tests are from a 
battery of testb that was developed as p pari of a previously 
cdfnpleted Center project (Harris & Harris, 1973 ). Only 
sluder^^s in grjde 5 participated in that study. The CAA 
tests were administered to assess student cognitive skills in 
three Lalecjor)es~-numerical ability, memory, and word fluency. 

Scalinj( of Variables 

Th^' structural model was formed before the variables 
used if^ tiie model wore created. However, the model was 
f(Hrnu(l with kru)wledge of the information from which the 
vjrit)l)i.*s were created. To build scales for each variable i* 
the rnodol severnl steps were followed. First, all items from 
all rjon-tudc^nt instruments were grouped together. Second, 
th<» evaluative staff indepenciently divided the items into sets 
t)! itffiiv., K\\L\^ represer^tativG of a single variable. Having 
foiloweci thib procedure independently, the group met and 
reaciied consensus on groups of items that defined a partic- 
ulcir variat)le. After tfiis procedure for selecting item sets, 
r.tc h (iroup of items wcJS given a verbal description that 
reflet ted the ini'jrriiativ)n contcHned in its constituents. Next 
the selected items in eacl^ grou[) wore combined to form a 
comp(;site varicibla. 
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Table 5-1 
Phase 1 Staff Questionnaires, 



Instrument Title 



Staff Background Information^ 

IGE Implementation Survey^ 

Job Satisfaction Survey^ 

Assumptions About Conditions 
of Effective SchoolingC 

Assumptions About Learning 
and Knowledge^ 

Role of the Siiaff Teacher® 

Instructional Practices in 
Heading, Mathematics, and 
Language Arts^ 

Instruction and Research Unit 
i^tructure and Function^ 

Instructional Improvement Com- 
mittee Structure and Function^^ 

IGE Schools Questionnaire, 
Verification Copy 



School Respondents 



> 

Each staff member 



Each staff member in 
grade 2 and grade 5 unit 

Each staff member in 
grade 2 and grade 5 unit 

I & R Unit groups, grade 2 
and grade 5 

lie group 
Principal 



^Frum Mendenhall, 19 77, 
^From Klausmeior, 1976, 
*^Derived from Lipham & Frutii, 1976. 
'^From Barth, 1971 
From Ironside, 19 72, 

'Adapti'd by T. .i. Vox from UeVault, 1973, 
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Table 5-2 
f^iase I Student Tests 



Test 



Grade(s) 



Short Form Test of Academic Aptitude (SFTAA)^ 
Comprehensive Tests of Basic Skills (CTBS) , Form 

Reading Vocabulary 

Reading Comprehension: Sentences 

Reading Comprehension: Passages 

Reading Comprehension 

Mathematics Computation 

Mathematics Concepts & Applications 

Speliin)^^ 

iielf Observation Scales (SOS),^ Form C 
Locus of CvMitrol (Cromwell, 1964) 
Concept Attainment Abilities (CAA) 

Number Series 

Number Relations 

Picture Class Memory 

Remembering Classes: Members 

Omelet 



f 



2,5 

2,5 
2 
2 
5 

2,5 
2,5 
5 

2,5 
2,5 

5 
5 
5 
5 
5 



^Grade 2, Ltvel 1: Grade 5, Level 3. 
'^Grade 2, Level C; Grade 5, Level 2 

Administered as a CAA word fluency substitute. 
*^Grade 2, Primary Level; Grade 5;, Intermediate Level. 

Not included in the analysis beccuse of low reliability. 



Not included in the analysis, 
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fldd tluTf* liVAin n»sourcos drul time, it clearly would have 
becri preferabk^ iu bu'ld qut:slionnaire iturns specifically to 
meabure the constructs for the model. As it was, items from 
dVciilabL ir^struments were used to scale the variables. For 
most Vcjndbles, there were many pertinent items available, so, 
for th(;bi.' variables, little daniago was done by relying upon 
dvailtible c^uestionnairos. 

Another limitation of the data stems from the remoteness 
of the data collection procedure and the amount of time it 
took school staff members to respond to the questionnaires. 
Thib questionnaire form of dava collec.ion invites hurried 
responses. Moreover, respondents may have wanted to 
res-^jfui as they thougfit good ICE citizens should, since they 
knew that the responses would be sent back to the Center. 
There is no doubt that the signal one wants to receive comes 
partly veiled with noise when one uses questionnaires. 

The evrjiuation staff was aware of these limitations from 
tfu! oulboi and took steps to minimize their effect. An inno- 
vtjtiv(^ use of questionnaire responses was developed which 
deserves mention. Usually questionnaire items, like test 
items, .ire Lombined in a linear manner to form a scale. That 
was not always done in our study. Rather, Boolean logical 
expr'essions were often used to combine the responses on 
several items into new, composite items to be arranged on a 
•>caie. For measurement purposes, these composites were not 
themselves present in any questionnaire. They were the 
f^roduct of logical operations performed on multiple ques- 
tiormaire items. 

There were two reasons for taking this approach to 
scdliruj. One was to "cjoof-proof" our variables. The detec- 
tior) tjf contradictions and otfier convergent uses of ques- 
tionnaire responses were used to minimize tfic extent to which 
our scdied values could be thrown off by erroneous responses. 
Some forms of (Jistortion were anticipated, and scaling deci- 
sions were made to minimize their effect. A second reason 
for the approacfi had nothing to do with accuracy of responses. 
Irj somi* Ldsos we decidetJ tfiat, ever^ if we assumed the respon- 

> worv perfectly accurate, a justifiable ordering would not 
be obtaifu^d by aritfimetic combination of item respons-"^. 



Tfu' model presentcci in Figure 5-1 has 11 variables. 
The first, (1) in Figure 5-1, in tfie dependent variable. Five 
different tlof)c-ndent variables were used, teacher job- 
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s<itibf<jctiori (JOUSAF) cind fuur variables associated wiih 
student achievenont (reading and math at grades 2 and 5). 
Six of the variables, (6) to (11) in Figure 5-1, measure 
aspects of the school as a whole, such as organizational 
features, schoolwide practices, and staff background. Thus 
a single score was derived fur each school. Teacher job- 
satisfaction was tilso a sclioolwide variable. The olher 
variables, (2) to (5) in Figure 5-1, do not pertain to the 
school as a whole; they are measures of a specific 
I 8 R Unit's practices in reading and in maui. Each variable 
specific to an 1 6 R Unit was actually treated as four 
separate variables. It was measured in two 1 & R Units per 
school-~one that included children of grade 2 agu and one 
that included children of grade 5 age. in each i & R Unit, 
there wab o reading version and a math version of the vari- 
able . 

A more elaborate definition of each variable and huv; it 
w«is V alecJ hcis been published in a series of technical re- 
ports, hsted in Table 5-3. Readers wanting to know more 
.\\)o\j\ a specific variable should refer to the report which 
corrtjsporujs to that variable. For reference, the mean and 
staruitjrd devMtii)n (^f each variable are given in Table 5-4. 
AcJditional descriptive statistics are given in each appropriate 
techrucal report . 

before procecdirig to the results, a description of how 
student achievement scores were derived for each unit is in 
order. The student achievemerU variables used in the analy- 
sib were not simply raw scores, but residual scores derived 
from the ciifferences between raw and predicted" scores on 
«uh'ovement tests. Each student's scores on academic ability 
tests were used to predict his or her scores on the achieve- 
M'fnt ti!Sts, Pr\or to their use js covariates, the scores from 
j^.<idonii( .tbility tests were themselves adjusted to minimize 
rnuasuruniirnt error. Implausible combinations of ability test 
sut^scores were adjusted by a procedure known as "winsoriza- 
ttori" (see Technical Reports T^o. 508 and No. 509). The 
studerit's .iftu.il scores on achievement measures were then 
coinpcjriHi witK pri'dictions based on adjusted ability test 
suire*.. The devuiiions of the actual scores from the pre- 
ditted scores were the variables of interest. 

The resicjuul scores of individual students on CTBS 
subtests [>r()vicled the basis for an aggregated measure repre- 
seritifu) e,i( fi schuol. The sut;tests are listed in Table 5-2. 
The scores of e^ich group of ♦.tudents in each school wer« 
averaged t() form a school mean tor eat h subtest. In other 
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Table 5-3 

Rep'jrlb D(thv:ribing Variables Usee in Phase I 
dncJ Results of Phase 1 Study 



Technical ERIC 





Report No. 




No< 




Schoolwide Variables 


Interorganizational Relatione (lOR) 


476 


ED 


182 


332 


Procedures Fostering Coordination and 
Improvement of the School Program (COS) 


477 


ED 


182 


335 


General Staff Backg -ound (GSB) 


478 


ED 


182 


329 


Int raorganlzar ional Structure (lOS) 


479 


ED 


182 


333 


Belief in Individual Differences (INDIV) 


480 


ED 


182 


327 


School's Demographic Setting (DB) 


482 


ED 


182 


336 


Schoolwide Implementation of the 
Inyfruct lonal Programming Model (SIPM) 


483 


KD 


182 


328 


Teacher uob Satisfaction (JOBSAT) 


484 
512 


ED 
ED 


18i! 
186 


337 
426 


I & R Unit Specific Variables 


Utilization of Currlcilum Resources (UCR) 


485 


ED 


182 


338 


Information Acquisition ('A) 


486 


ED 


182 


331 


Individualization of Instructional 
Decisions 


487 


ED 


182 


330 


Managjjr.vnt of Grouping and of 
Instructional Continuity (IE) 


488 


ED 


182 


334 


StudlJ^^ Achievumt-nt Variables 


Grade 1 Reading 


508 
510 


ED 
ED 


183 
185 


598 
jJ8 


Grade 2 Mathematicj 


508 
311 


ED 
ED 


183 
199 


598 
084 


Grade 3 Heading 


309 
510 


ED 
ED 


183 
185 


597 
538 


Grade 3 Mithematics 


509 
311 


LD 
ED 


183 
199 


597 
084 



Note: Scaling of a v\rlabie is described It he first, or only, 
ruport for that variable* Where two reports are listed for a 
variable, the second reports results of the structural equations 
aUcil ys is ♦ 
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Table 5-4 
Means and Standard Deviations 



Standard 

Variable Mean Deviation 



Schoolwide Measures 

lOR 20.49 6.81 

lOS . 20.5?. 3.80 

COS 58.18 9.91 

GSB 3.84 .62 

INDIV 3.16 .18 

SIPM 62.44 12.26 

JOBSAT 40.57 5.08 

Second-grade I & R Units: Reading 

UCR 44.85 9.59 

lA 7.00 1.00 

IDM 8.16 2.38 

IE 28.64 6.12 

CTBS Reading Achievement, adjusted -.45 6.69 

Second-grade I & R Units: Mathematics 

UCR 39.53 9.61 

lA 7.18 1.28 

IDM 8.33 2.60 

IE 29.58 6.12 

CTBS Mathematics Achievement, adjusted -.26 3.47 

Fifth-grade I & R Units: Reading 

UCR 44.77 9.89 

lA 6.93 1.02 

IDM 7.51 2.18 

IE 26.34 5.91 

CTBS Reading Achievement, adjusted -.26 3.47 

Fifth-gxade I & R Units: t-latheraatics 

UCR 40.15 9.53 

lA 7.39 1.16 

IDM 8.09 2.55 

IE 28.54 7.80 

CTBS Mathematics Achievement, adjusted -.10 4.60 
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words, the adjusted scores (regression residuals) of students 
in an I S R Unit were averaged to provide a representative 
measure ot (ability-jdjusted) student achievement in that 
I 6 R Unit. 

After aggregation, I 6 R Unit means on residual scores 
from achievement subtests were combined to form an overall 
reading achievement score and an overall math achievement 
score. Overall scores could not have been formed for indi- 
vidual students because, with a few exceptions, a given 
Individual took only some of the subtests. 



The positive relationships implied in the model between 
features of ICE schools and measures of students' achievement 
were not found in either grade. In grade 2 I & R Units, no 
organizational variable and no measure of instructional prac- 
tices was correlated beyond a trivial level with either reading 
achievement or math achievement, although two correlations 
were statistically significant. Reading achievement had a 
correlation of .197 (p < .01) with General Staff Background 
(CSB), and math achievement had a correlation of .255 (p < 
.01) with General Implementation of the Instructional Pro- 
gramming Model. 

The results in grade 5 I S R Units were similar. Every 
variable was correlated only trivially with the reading achieve- 
ment and math achievement variables. Mot a single correla- 
tion differed from zero with statistical significance. 
Accordingly, the structural equation analysis lends no 
empirical support to hypothesized paths of influence. 

This negative finding may, in part, indicate faults in 
our measurement of organizational features and instructional 
practices. However, not all of the blame can be placed on 
the attenuating effect of noise in the measures, because 
ratings of organizational features made by field observers in 
30 schools (see Ironside & Conaway, 1979; condensed into 
chapter 6) showed reasonably high correlation with the 
questionnaire-based scales (lOR, .66; GOS, .53; lOS, .60; 
SIPM, .67). T.iere is less assurance that our measures of 
instructitjnal practices are trustworthy. 
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The standardized, group-administered measures of read- 
ing and mathematics achievement can be criticized as an 
Inadequate indication of what children know about reading or 
mathematics. The tests may have some sections and items 
that do not reflect the curriculum of the schools in our 
study. However, the instruments seem to provide a reason- 
able assessment. Other information we have indicates that 
tfie test scores are reasonably accurate. Different demo- 
graphic classifications of schools, for instance, show dif- 
ferences on the reading achievement and math achievement 
measures that closely parallel the findings in the National 
Assessment of Educational Progress. 

Organizational Features 
and Instructional Practices 

The following discussion examines links between 
organizational features and the instructional practices they 
were meant to facilitate. Analysis began with an estimation of 
the a priori model. The initial estimation procedure was a 
straightforward application of multiple regression. For each 
path in Figure 5-1, path coefficients (standardized multiple 
regression coefficients) were estimated for the full a priori 
models of grade 2 reading, grade 2 math, grade 5 reading, 
and grade 5 math, respectively. These coefficients were 
subjected to a statistical test. The a priori model was re- 
vised on the basis of those tests. Causal links hypothesized 
in the a priori model whose path coefficients did not differ 
statistically from zero were dropped from the models. In 
effect, such a procedure tests whether a variable used as a 
predictor accounts for any unique variance in the dependent 
variable. 

Pat' theoretically precluded from an a priori model were 
hypothesized to make no increment to R beyond that obtained 
by using the path included in the model. The omitted paths 
of greatest interest lead directly from remote causes to 
cffects-~bypassing theorized mediators. When the addition of 
a direct path from a remote cause—a path theoretically pre- 
cluded heretofore--was statistically significant, a model was 
deemed insutficient to explain the observed relationship 
between the effect and that remote cause. The correlation 
matrices, path diagrams, and estimates for both the hypothe- 
sized models and the fitted models are given in Technical 
Reports No. 510 and No. 511 (Price, Janicki, VanDeventer, G 
Romberg, 1980a, 1980b). 

When predictors are interrelated — as they are here — 
interpretation of the tests for particular path coefficients can 
be easily misleading (sec Goldberger, 1964; Cordon, 1968). 
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The organizcitional features in this study were interrelated, as 
were the instructional variables; therefore, the substantive 
interpretation of individual path coefficients becomes ambig- 
uous. 

To get a clearer understanding of the relationships 
between the organizational and instructional variables, another 
type of an-'lysis was used. We used orthogonolized predic- 
tors, which are unrelated to each other and are linear com- 
binations of the initial set of predictors. Interpretation of 
coefficients of orthogonalized predictors is possible only to 
the extent that the orthogonalized predictors can be defined 
in a substantively meaningful way. 

Orthogonalization of organizational variables. The six 
organizational variables in the model were transformed 
through principal components factor analysis into a set of six 
uncorrelated (orthogonal) factors. Varimax rotation was used 
on the full set of principal components. The net effect of 
performing these transformations was to impose orthogonality 
on the set of six predictors, while preserving as closely as 
possible a one-to-one correspondence between variables and 
principal components. Correlations between the six ortho- 
gonal factors and the six untransformed variables are given 
in Table 5-5; these correlations are a special type of factor 
loading. As is evident in Table 5-5, each of the six factors 
is a good proxy for one of the variables and is negligibly 
related to the other five variables. Thus, the orthogonalized 
predictors are substantively meaningful, so their coefficients 
in a regression equation do permit some interpretation. 

When predictors are orthogonal like this, standardized 
regression coefficients are equivalent to correlation co- 
efficietUs. Therefore, results based on orthogonalized 
predictors are presented as correlation coefficients. 

Orthogonalization of instructional variables. For each of 
the four models (grade 2 reading, grade 5 reading, grade 2 
math, grade 5 math), the four instructional variables in the 
model were transformed through principal components factor 
analysis iruo a set of four uncorrelated (orthogonal) factors. 

Correlations between the organizational factors of Table 
5-5 and instructional factors were found to be generally 
nnnsignificant: even those five that were statistically sig- 
nific.Hit were nevertheless weak. Our discussion is limited to 
those correlations that were statistically significant in both 
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Correlations Between the Organii!ational Variables ana 
Their Var'nax-Rotated Principal Components 



Factors 

Variables ~ ^ ~ — ■ — - 

GOSFAC lORFAC IPMFAC INDIVFAC lOSFAC GSBFAC 



COS 


.76 


.38 


.36 


.23 


.29 


.10 


lOR 


.24 


.89 


.25 


.20 


.20 


.09 


IPM 


.25 


.26 


.87 


.22 


.23 


.12 


INDIV 


.14 


.17 


.17 


.96 


.06 


.06 


lOS 


.06 


.18 


.19 


.06 


.94 


.13 


GSB 


.06 


.08 


.09 


.06 


.11 


.98 


Eigenvalue 
of factor 


.72 


1.07 


1.02 


1.07 


1.08 


1.01 



grades 2 and 5 in either reading or math. Three such rela- 
tionships in reading and mathematics are listed in Table 5^6. 
Weak but statistically significant correlations occurring in only 
one grade were regarded as undeserving of serious attention. 

The correlations in Table 5-6 are weak, but they are 
statistically significant. Except for the *^elationship between 
GOSFAC and UCRFAC, which was statistically significant at 
both grades in mathematics only, the other three relationships 
are statistically significant in both reading and mathematics at 
both grades 2 and 5. Thus, although those correlations are 
weak, they do persist at a statistically significant level. 

Two of the persistently significant correlations involve 
the orthogonalized measure (IDMFAC) of the I 6 R Unit's 
Individualization of Instructional Decisions (IDM). 
I 5 R Units that scored high on IDM tended to be part of a 
school that scorecl. high on schoolwide aspects of the imple- 
mentation of the Instructional Programming Model (IPM), as 
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Table 5-6 

Bivariate Relationships That Had Statistically 
Significant Correlations With Student Achievement 
in Both Grades 







Correlations 


Factors 




Grade 2 


Grade 5 


Reading 


lOCFAC & IDMFAC 




.14 


.22 


INDIVFAC & lAFAC 




.23 


.20 


SIPMFAC & IDMFAC 




.15 


.15 


Mathematics 


lOSFAC & IDMFAC 




.19 


.15 


INDIVFAC & lAFAC 




.24 


.18 


SIPMFAC & II)MFAC 




.13 


.17 


GOSFAC & UCRFAC 




.17 


.17 



indicated by the persistent correlation between SIPMFAC and 
IDMFAC. This finding is consistent with the assumption made 
in ICE that schoolwide implementation of the IPM affects its 
implementation at the level of individual I & R Units. 
I 8 R Units that scored high on IDM also tended to be part 
of a school that conformed to the intraorganizational structure 
recommended for ICE schools, as indicated by the persistent 
correlation between lOSFAC and IDMFAC. 
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The other relationsfiip marked by persistently significant 
correlations is that between INDIV (q measure of the extent 
to which teachers in a school believe that individual differ- 
ences are important to consider when making instructional 
decisions) and lA (a measure of the extent to which an 
i S R Unit collects information about individual differences in 
reading and mathematics, respectively). The correlations 
supporting this statement are those between the orthogonal- 
ized measures INDIVFAC and lAFAC. Although these correla- 
tions are weak, they are persistently significant, and they do 
suggest that teachers who believe in the instructional impor- 
tance of individual differences are more likely to collect 
information of a kind that will support the individualization of 
instructional decisions. 

As mentioned earlier, the correlation between COSFAC 
and UCRFAC was significant at both grades 2 and 5 only in 
mathematics. The a priori model did predict positive correla- 
tion between COS (Procedures Fostering Coordination and 
Improvement of the School Program) and UCR (Utilization or 
IPM-compatible Curriculum Resources by 1 & R Units), but 
the model predicted the positive correlation in both reading 
and mathematics, not just in mathematics. 

Job Satisfaction 

The premise that teacher job satisfaction is affected by 
particular organizational features of ICE has been represented 
as a network of postulated causal links among the variables. 
Figure 5-2 presents the various causal links in diagram form. 
It shows the paths of influence assumed a priori to underlie 
the relationships between teacher job satisfaction and the 
other variables. 

Four variables, Interorganizational Relations (lOR), 
Procedures Fostering Coordination and Improvement of the 
School Program (COS), Intraorganizational Structure (lOS), 
and Ceneral Implementation of the Instructional Programming 
K\ode\ (SIPM), are hypothesized to relate to teacher job 
balisffiction . The model in Figure 5-2 suggests that the 
amount of communication with other ICE schools (lOR) should 
hel[) teachei s fee! better about their skills and be more 
satisfied witn teaching. The structural model also suggests 
that schools with a well functioning ICE program (schools 
iiicjii on COS, lOS, and SIPM) would have satisfied teachers. 
The mode! indicates that Cerieral Staff Background (CSB) and 
Belief in Individual Differences (INDIV) indirectly affect 
teacfior job satisfaction by way of SIPM. Factors affecting 



94 

ERJC 103 




»#• I . f . r 




. r f . f 





Figure 5-2, A priori model for teacher job satisfaction, 

(From Price, Romberg, 8 Janicki, 1981, p. 78.) 



SIPM are discussed more completely in Technical Reports 
No. 510 and No. £11 (Price, Janicki, Van Deventer, 6 
Romberg, 1980a, 1980b). 

As with the analyses presented already, the analysis 
began with an estimation of the a priori model. Each 
endogeneous variable was regressed on its theorized causes. 
As a set of predictors, organizational features in the a priori 
model account for 29.1% of the variance in teacher job 
satisfaction, which is statistically significant (£ <.001). For 
studies of this kind, 29.1% of the variance is good prediction. 
Whether one should regard good empirical prediction like this 
as practically significant depends on the interpretation given 
to the empirical relations. how<3ver strong they are. By 
addincj exogenous variables that had not been included a 
priori as predictors of teacher job satisfaction, the multiple 
R is .301, which is only a 1% increase in variance explained. 
That small increase is not statistically significant (p < .25). 
Since the a priori model is approximately as predictive as is 
the fuller model, we a*-e inclined to judge the a priori model 
to be adequate. However, lOS had a negative regression 
coefficient, which does give some pause; the a priori moael 
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would have thdl cotfficient be positive. The zero-order 
correlation of lOS with JObSAT is. in fac;, positive. It is 
.18 (£ < .05, one-tailed test). The negative coefficient is 
incor^sistent with the interpretation implicit in the a priori 
model. The contradictory interpretation is that the features 
measured by lOS have a weakly negative effect on JO&bAT, 
which is not apparent by examination of zero-order correla- 
tions because of the countervailing influence of lOR, COS, 
and SIPM, wi;h which lOS is positively correlated. However, 
neither the a prior interpretation nor the contradictory 
interpretation are unequivocally supported by these results. 

As notea in earlier analyses, the intercorrelation of 
predictors makes any interpretation of particular coefficients 
treacherous. For that reason, the procedure of orthogonaliz- 
ing predictors was again used. The uncorrelated, substan- 
tively interpretable factors defined in Table 5-5 were used as 
predictors of JOBSAT. By having predictors that are uncor- 
related among themselves, path coefficients can be compared 
cind tested without ambiguity— as long as the variables used 
as predictors are themselves substantively meaningful. 

Orgonuationol features as predictors . Factors corres- 
ponding to three organizational features had correlations with 
JOBSAT that were statistically significant and of noteworthy 
magnitude. The factor irresponding to COS had a correla- 
tion of .32 (£ < .00001 .ne-tailed test) with JOBSAT. The 
factor corresponding to lOR had a correlation of .31 (p < 
.0001, one-tailed test), and the factor corresponding to SIPM 
had .24 < .01, one-tailed test). The zero-order correla- 
tion coefficients reported here are equivalent to the stan- 
dardized regression coefficients of JOBSAT regressed on the 
factors corresponding to COS, lOR, and SIPM {R = .261). 
That equivalence is inherent to perfectly uncorrelated pre- 
dictors. The zero-order correlation of the factor corres- 
ponding to lOS, another organizational variable, is .02, which 
is statistically nonsignificant and trivially small. 

School staff measures as predictors . Besides the four 
organizational features discussed in the preceding paragraph, 
two measures of the school staff, INDIV and CSB, were 
treated as causally prior to JOBSAT. The correlation of the 
factor corresponding to INDIV with JOBSAT is .20, which is 
statistically significant (£ < .01, one-tailed test). The 
correlation of the factor corresponding to CSB with JOBSAT, 
on the other hand, is -.03, which is trivially small and 
statistically nonsignificant. The addition of the* factor 
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corresponding to INtJiV to the predictor set of COS, lOR, 
and ^IPM improved the prediction of JOBSAT from R = .7 
to R = .299, a statistically significant increase. 



The conclusion of this chapter considers the findings of 
the Phase I study, dividing them for sake of exposition into 
five parts. 

Organizational Features 
and Instructional Practices 

Part of ICE schooling consists of organizational features 
designed to facilitate the instructional practices that compose 
the Instructional Programming Model. Because those organiza- 
tional features have as a primary purpose the facilitation of 
certain instructional practices, the Phase I study examined 
empirically the implied relations between organizational 
features and instructional practices. Some implied correla- 
tions between organizational features and instructional 
practices were borne out in the Phase I data; others were 
not. The impliea relations that were borne out empirically 
were presented in Table 5-6. The practice of individualizing 
instructional decisions—an instructional practice pursued to 
varying degrees by I e R Units in the schools studied— does 
seem to be facilitated by cerlain schoolwide organizational 
features. 

Schoolwide implementation of the IPM. The extent to 
which the Instructional Programming Model (IPM) had been 
implemented by the school in general (and not simply in the 
I S R Units studied) was positively correlated with the degree 
to which the specific ! & R Units under study engaged in the 
individualization of instructional decisions. This finding mav 
surprise no one, but it dues attest to the susceptibility of 
small groups of teachers to the larger (schoolwide) milieu in 
which they are situated. 

Intraorganizational structure. Another aspect of the 
larger milieu that was consistently associated with 
I & R Units' individualization of instructional decisions is the 
intraorganizational structure of the school. (This is a proxy 
for various structural arrangements distinctive to the ICE 
schools, such as the organization of staff and students into 
I Z R Units and the existence of a functioning Instructional 
Improvement Committee.) These correlations with I S R Units' 
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individualiiidtion of instructional decisions offer some vin- 
dication of the organizational theory contained in the IGE 
system. According to that theory, individuals who are part 
of an organization are affected by controllable features of that 
organization , 

Implied correlations not found, :>ome impliccj cui i li.auCfiS 
between organizational features and instructional practices 
were not borne out by the data in a consistent fashion. An 
expected connection between the interorganizational relations 
of a school and the utilization of I PM-compatible curriculum 
materials by I S R units in that school was not found. 

Second, the expected connections between schoolwide 
implementation of the IPM and utilization of I PM-compatible 
materials by I & R Units, collection of information about 
individual differences, and the I & R Unit's management of 
CjTouping and instructional continuity also were not found. 

In cases such as these, where expected relations were 
not found, three types of explanations can be offered. The 
first might be called a "model-blaming" explanation, because it 
faults tht underlying model that has failed under test. The 
second and third might be called "test-blaming," because they 
fault the procedures that have been used to perform the test 
of ihe model. The second attributes the lack of observed 
relation to faulty measurement of the predictor variables (in 
tliis case, measures of schoolwide organizational features). 
This explanation seems to have little ground in this case for a 
couple of reasons. The Phase I measures of schoolwide 
organizational features agreed reasonably well with counter- 
part measures obtained in the Phase II field validation study 
(bee chapter 6). Furthermore, other parts of the model were 
borne out by correlations involving these variables, a cir- 
cumstanco which should riot have arisen if these variables 
were badly measured. 

The third type of explanation attributes the lack of 
observed relation to faulty measurement of the predicted 
Vcjridbles (in this case, measures of I & R Units' instructional 
practices). This type of "test-blaming" explanation cannot be 
seriously disputed. There was no field validation of these 
measures, there was abundant opportunity for distorted 
iriformation to enter the questionnaires, and there are no 
redeemingly high correlations to suggest that these variables 
wore measured reliably. The measures of I 6 R Units' instruc- 
tional practices are the least trustworthy part of ihe Phase i 
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study. For this reason, we are disinclined to engage in 
"model-biaming" when data involving these particular measures 
of instructional practices are Involved, 

Staff Beliefs and Instructional Practices 

The beliefs that staff members hold about the value of 
ICE are obviously important. The instructional practice of 
collecting information about individual differences between 
students in content areas (reading and mathematics) was, as 
expected, correlated with a measure of the extent to which 
teachers in a school believe that individual differences are 
important to consider when making instructional decisions. In 
the presence of other factors likely to affect this important 
element of ICE practice, it is noteworthy that its strongest 
predictor in Phase I was the extent to which teachers in a 
r joI believed in what one could reasonably argue is the 
most basic tenet of the Instructional Programming Model, 
namely, that individual differences are pertinent to instruc- 
tioniil decisions. 

Instructional Practices 
and Student Achievement 

In no instance--not in reading, not in mathematics, not 
in grade 2, not in grade 5 — was there a statistically signi- 
ficant correlation between a measure of instructional practices 
and a measure of student achievement. Besides the "model- 
blaming" explanation for this, which would fault the Instruc- 
tional Programming Model, there are two other types of 
explanation. One attributes the weak relations to bad 
measurement of student achievement; the other, to bad 
measurement of instructional practices. Student achievement, 
we believe, was measured reliably. Desp.'te the reliability 
with which student achievement was measured, any standard- 
ized, group-administered test can be criticized as an imper- 
fect reflection of what children know about the area assessed 
by the test. Persons who wish to make that criticism of the 
student achievement measures — a criticism of construct validity- 
must concommitantly dismiss any favorable findings based on 
outcome measures such as these. We have already mentioned 
the low trust we place in our measures of instructional prac- 
tices. Consequently, unreliability in those measures may 
have attenuated correlations between instructional practices 
and studeiit achievement. For that reason, we are disinclined 
to Ubr this particular negative finding as a basis for 
"model "blaming," 
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Organizational Features 
and Student Achievement 



Expected correlations between organizational features and 
student achievement were not found, despite reliable measure- 
ment of both classes of variables. All measures of organiza- 
tional features were trivially and nonsignificantly associated 
with student achievement measures. With regard to this 
negative finding, a "model-blaming" explanation is the most 
plausible. Specifically, these findings indicate that imple- 
mentation of the surface organizational features with which 
ICE is commonly identified offers no assurance at all that 
student achievement will be raised. Evidently, the instruc- 
tional effectiveness of I S R Units included in Phase I did not 
depend on the degree to which ICE organizational features 
had been implemented in the school of which they were part. 
This finding (based on questionnaire data) resonates with the 
findirigs of other phases of the ICE evaluation, all of which 
have converged on the conclusion that surface orthodoxy 
reveals little if anything about the value of an educational 
program. Nor does it reveal whether the Instructional Pro- 
gramming Model is practiced in a form that would be recog- 
nizable by its developers. 

Correlates of Ifeachers' Job Satisfaction 

The foregoing discussion followed a long-standing 
tra/ition in educational evaluation by gauging the worth of an 
educational, option on the basis of its effects on the students. 
There do exist other grounds on which to evaluate educational 
programs. In an era when "teacher burnout" has become a 
household word, one evident altei^native is to evaluate the 
effects of programs on staff ^^^^le. On those grounds, three 
organizational features commot associated with^ ICE fare 
well. Three schoolwide organi nal features tfave positive 
correlations (and positive path v efficients) with the school • 
wide measure of teacher job sijcisfaction. Those three features 
are: (1) the interorganizational relations of the school, 
(2) the existence of procedures fostering coordination and 
improvemerit of the school program, and (3) general, school- 
wide implementation of the Instructional Programming Model. 
Underlying these positive relations appear to be two factors. 
One is that teachers like the contact with other adults pro- 
vided by ICE, especially the contact with a professional 
network lhat extends beyond their particular school. The 
other is that job satisfaction is derived from a belief that 
their instructional efforts are effective, a belief commonly 
held by teaciiors of schools in which the IPM had been imple- 
r^erited on a schoolwide basis. 
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CHAPTER 6 



Phase II: THE ON-SITE VALIDATION 
OF IGE IMPLEMENTATION* 



As outlined in chapter 3, there were three primary 
purposes for this phase of the project, 

1. To validate and clarify both specific and general Phase I 
self-report data at school and unit levels. Topics included 
basic school information, school wide objectives, ICE subjects 
and instructional programming, IIC and unit operations, re- 
sponse sets, disparate staff ratings on ICE status items, 
apparent inconsistencies in related responses. 

2. To gather new and extended information for (a) descrip- 
tive purposes, (b) possible use in Phase I analysis, and (c) 
development of hypotheses. Topics included implementation 
history, Phase I testing conditions, staff development 
activities, the Home School-Community Relations component, 
instructional modes, awareness and utilization of state ICE 
networks at various levels. 

3. To study the dynamics of the ICE implementation and 
maintenance processes in a range of situations, from an 
"outside" perspective. This purpose allowed the team visitors 
to pursue additional topics and to derive somewhat personal 
perceptions of the nature of ICE beyond the formal 
requirements related to the two objectives above. 



The sort of validation carried out in the Phase II study 
must be understood as nonstatistical. One might look at the 
Phase II validation effort, in other words, as an attempt to 
suggest on an essentially impressionistic basis the extent to 
which Phase I responses may be construed as providing 
accurate descriptions of the ICE status and activities of the 
Phase II sample. Three validation approaches were used in 
the Phase II study: (1) validation through direct confirma- 
tion of data, the most commomy employed approach; (2) vali- 
dation by means of supportive and related information; and 
(3) validation as the fulfillment of intended procedures. 



*This chapter is condensed from the final report 
submitted by Ironside and Conaway of Research Triangle 
Institute. The condensation was done by Deborah M. 
Stewart, project monitor for the Phase II subcontract. 



Roderick A. Ironside and Lari-y A. Conaway 



THE VALIDATION PROCESS 



103 



ERIC 




It was possible lo confirm Phase I responses to a series 
of questionnaire items by means of direct discussion of items 
in the field (sometimes with reference to the school's Phase I 
data), intervievvs. observations, and study of matericils. In 
this sense, corroboration was accomplished by both direct and 
indirect means, where the purpose was to verify the )riainal 
known response. ^ 

The supportive approach of gathering related information 
was employed in Phase II in connection with extension material 
on such topics as instructional practices, objectives, and 
cooperative planning. Even where such related items wero 
not exactly the same as the original Phase I items, they were 
used for validation purposes judgmentallv so long as the 
Phase I responseb were known. In this"i-ense. too. it was 
possible to employ the broad judgments thai emerged from the 
site visit to each school and across jII thirty schools. 

With respect to the third approach to validation. Phase 
II provided an opportunity to examine the extent to which the 
Phase I instruments elicited the requisite information, the 
nature of respondent reactions to the instruments per se and 
the relationship between the quality of data obtained and' the 
variables with which those data were associated. They may 
be viewed as validation in the least rigorous sense, since it is 
dependent upon the judgments of the participants— Phase 1 
respondents and Phase II site visitors/interviewers. It 
nonetheless provides one basis for judging the efficacy of 
various Phase I instruments and the implications for the 
several variables represented. 



PROCEDURE 
Sample 

Research Triiingle Institute (RTI) and Center staff 
jointly set up criteria to select schools from the Phase I 
roster. 



The Phase II sample of 30 schools was characterized as 
follows: 



1. Located in 16 states from coast to coast, with a purposeful 
deerr.phasis on proportional representation from several states 
with iarqe numbers of ICE schools; no more than 6 schools in 
any one state; most states had I or 2 schools. 
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2. Initial relationships with one or a combination of three 
sorts of agencies (R&D Center, /1/D/E/A/, or a state 
educational agency), 

3. ICE initiation spread from 1969 to 1975. 

4. School size from fewer than 150 students to more than 
1200. 

5. Total scores on the ICE Implementation Survey ranging 
from 24 to 285 of a possible total 308 (in two subgroups: 
scores 24-132 and 191-285). 

With respect to the last characterization, one feature of 
sample selection was that half of the schools were to 
represent the bottom of the scale and half the top. 

Extensive communication by telephone and mail with 
school principals, district personnel, and state ICE network 
contacts occurred as arrangements were made for the Phase II 
site visits. 

Topical Outline 

To provide structure for the school visits, a Topical 
Outline of content was developed. While the Center took on 
major responsibility for identifying the specific validation 
topics, RTI undertook the major developmental work in the 
"new information" topics. The outline was accompanied by a 
Team Visit Report Form for RTI staff. Th's form allowed for 
collection of specific categorical information as well as entry 
of narrative material. 

I. SCHOOLWIDE CONTENT AND TOPICS 

A. New Information and Extended Information 

1. School implementation history 

2. Cost factors 

3. Inservice training 

4. Kome-School-Community Relations 

5. Unanticipated outcomes 
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B. Ve? Ification-Clariflcation 

1. IGE School Survey verification. Staff Information 
Sheet, and local demography 

2. I!C Structure and Function Questionnaire 

3. ICE Implementation Survey 

4» Assumptions about Schooling and about Learning 
II. UNIT CONTENT AND TOPICS 

A, New Information and Extended Information 

1. CTBS and local curriculum match 

2. Student curriculum activities and progress 

3. Conditions of Phase I testing 

B. Verification-Clarification 

1. Unit Questionnaire 

2. Unit Practices 



Visits of^from 1 1/2 to 2 days each took place in the 
period from early March to late May 1978. Typically, a team 
of two professionals made the visit. Interviewed and observed 
both individually and as a team, and conferred on their 
findings. In all, eleven different individuals participated in 
the field work, each visiting a total of from two to eight 
schools. This group of persons comprised nine RTI profes- 
sional staff and two consultants. 

Four major modes of data collection were used: Inter- 
view, observation, study of relevant materials, and atten- 
dance at stated meetings. Data collected during the visits 
were supplemented in all cases by relevant Phase II informa- 
tion obtained in advance from the principal, and in some 
cases by follow-up telephone contact to clarify visit findings. 



Early in the contract period the mate iai for validation, 
extension, and new information needs was subsumed into 
major questions that would serve as focal points in the in- 
quiry. The findings and interpretations respond to these 
questions, which are as follows: 

1. To what extent do the Phase I survey results reflect 
reality with respect to the school and ICE? Did staff answer 
carefully and honestly? Were procedures and directions 
followed? 



Site Visits 



FINDINGS 
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2. What are the turning points in Implementation, points at 
which problems to be overcn.ne appear Insurmountable and 
after which there is a period of smooth continuing operation? 

3. Are there general indicators or predictors of success/ 
failure as an ICE school? 

4. What are the specific features of implementation history of 
givers schools? Are there particular patterns? 

5. Is the staff attitude consistent with the concepts under- 
lying ICE? Do individuals vary in their assumptions about 
education? 

6. Is there cooperative planning regarding the Instructional 
program? Does it incorporate various teachers' strengths? 
Does it provide for continuous progress? 

7. How is the IPM implemented and is it based on specific 
schoolwide instructional objectives? What are the related 
curriculum practices and how are the ICE subjects handled? 

8. Is there a recognition of things well done coupled with a 
feeling of worl<ing toward improvement? Is the current status 
only temporarily satisfactory and thus plans laid for new 
growth? Are external sources sought'' 

9. Is there benefit from the networki; (at various levels)? 
Are the networl<s a source for refinement and renewal^ 

10. Does ICE co?t too much, in time, money, energy? Is it 
worth it? In addition to reporting results over the entire 
Phase II sample of 30 schools, RTI conducted an exploratory 
inquiry lising two subgroups of schools in an effort to as- 
certain whether high- and low- .nplementing schools differed 
systematically. Each subgroup consisted of seven schools, 
chosen on the basis of original total self-report implementation 
score and judgments arrived at after the field visits. Both 
sets of "ratings" reflect overall implementation status as of 
the 1977-78 school year* Implementation scores of the low 
subgroup rar^ged from 2U to 125 and high subgroup, from 122 
tu 285. The higli subgroup score of 122 was judged an ur^der- 
estimate; this group is better described as having scores from 
200 to 285. Scores 24 and 285 are the very lowest and very 
highest scores (of a possible implementation score of 308) of 

dll schools involved in Phases I and IL 
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Validation of Phase I Results 



The staff in almost all schools attempted to follow the 
survey procedures and answer the questions carefully and 
honestly, although ther^ were some difficulties reported that 
also affect the "reflection of reality," For example, personnel 
in about one-half of the schools indicated that survey instru- 
ments included many ambiguous terms — and in a fair number 
i of the schools there was a reaction that the surveys were too 

long. But local conditions in a few cases exacerbated these 
difficulties, caused Phase I to represent a special pressure 
because school had begun late, there had just been a teachers' 
union strike, enrollment changes had caused alteration of 
schedules and assignments, or a new principal had been 
appointed effective September 1977, In addition, in some 
schools it was mentioned that many survey items dealt with 
more than one element (as in the Implementation Survey), and 
that the level of detail asked for in connection with instruc- 
tional practices in various curricula was somewhat taxing. 

With respect to what may be called the "ICE environ- 
ment," a major concern (apparent in about one-third of the 
schools) was that the entire school or a significant part of it 
was not well enough acquainted with ICE concepts and termin- 
ology tc respond intelligently to a number of specific "ICE 
items." Many staff reported, nonetheless, that they had 
proceeded to respond either by guesswork or through consul- 
tation with others. Moreover, in several schools there was 
notable variation in the degree of acquaintance with ICE, 
making it difficult to obtain centrality in survey results 
within or across units. 

The RTI team at each school arrived at its own ratinys 
of II key items from the ICE Implementatiori 'iurvey that all 
school staff members had been asked to complete. Both the 
^taff ratings and the RTI ratings were made on a scale 
from 0, no implementation of the stated ICE concept, to ^, 
ideal implementation of the ICE concept. While both ratings 
have some obvious limitationF, comparisons were made of the 
difference between ratings, ignoring location on the 0-U scale. 

Tabin 6-1 shows the frequency of the difffrrpnces , in .05 
incremerUs, across all items and across all schools. There 
are two distinct tendencies in these data. First, of the total 
possible 300 comparisons, 129 (or 39%) show virtual compatibil- 
ity of the two ratings; second, of the remainder, a strong 
majority, aoV. place the Phase II ratir^gs below those rendered 
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Table 6-1 

Comparison of Phase II and Phase I Ratings for 
11 Key Items on ICE Implementation Survey 



Ratings 



Phase I I/Phase I Rating Comparison 




AO 


Phase II rating higher 






by 2.1 to 2.5 


2 


1 


by 1.6 to 2.0 


11 


3 


by I.I to 1.5 


14 


4 


by .6 to I.O 


36 


11 


Phase II rating same (+.5) 


129 


39 


Phase II rating lower 






by .6 to 1.0 


70 


21 


by I.I to 1,5 


27 


8 


by 1.6 to 2.U 


22 


6 


by 2.1 to 2.5 


10 


3 


by 2.6 to 3.0 


7 


2 


Pnase II unable to rate 


2 


1 


TOT A!. 


330 


99 



in Phase I, while 19% show Phase II ratings higher than those 
of the Phase ! ju Jymei its. It appears that the majority of 
schools were rated higher fo-* these eleven items by the 
school staffs in Phase 1 thiin by the Phase I'- visit teams. 

Quality of staff respon ^es to the Phase I questionnaires 
differed in the high- an^ low-implementing groups of schools. 
Based on all the sources of information available in Phase II 
(including the apparent extent 'o which school staffs in toto 
were knowledgeable of ICE concepts and terminology), it 
seems clear that the low group wer^ not only less informed 
about ICE anc' Phase I but also less inclined to participate. 
Many staff in the low group reported as much by acknowledg- 
ing hurry, resist, .ice, carelessness, pressure, and the like in 
the wny they handled Phase 1 requirements, with the notable 
exception of student testing. 
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This overall dUitudirujI domain is especially important to 
consider because, in the present case, it refers to respon- 
dents' general reactions to and handling of Phase I instru- 
ments and requirements, not merely the particular items or 
subinstruments specifically marked for validation work in 
Phase II. In addition--and we feel this to be a clue of 
considerable significance—the more a school or a staff was 
removed from ICE, the networks, terminology, expectations, 
implementation criteria, resources, and the like, the greater 
the tendency to dismiss the importance of Phase I and thus to 
treat it somewhat casually. From both the total implemen- 
tatiori scores and the Phase II field judgments, it is clear that 
the low group as a whole was quite far removed from the ICE 
mainstream, at least by the 1977-78 school year. 

Unit staffs were asked about the quality of the testing 
situation and, thus, test results as well as the content match 
between the local curriculum and Comprehensive Tests of 
Dosic Skills (CTBS) reading and mathematics tests. 

Unit staffs discussed the CTBS, examined copies, and 
rendered group judgments about tiie match between CTBS 
content and the curriculum in gene^-al in 1977-78 in those 
units (in fall 1977 where that could be specified). The 
findings presented in Table 6-2 should be interpreted as 
gross Indications of match, since many respondents found it 
nard to relate the measures to the fall 1977 curriculum, 
expressed reservations about standardized tests in general, 
and otherwise found this task somewhat difficult (note the 
number of unit with unclear responses, for example). 
Overall, Unit 5 groups judged a considerably higher level of 
test/curriculum consonance than did Unit 2 groups, for all 
subtests. 

Testing conditions themselves were explored based on 
recollections of unit staffs, principals, aides, counselors, or 
others who had administered the measures; some individuals 
recalled the details vividly, while most had some difficulty 
recreating the situation. The responses for Unit 2 and Unit 
5 grouptj were remarkably similar; thus what is discussed 
here is across the 30 schools. In 23 schools (76%) staff 
reaction was that the tests were appropriate and adequate; 
staff In 5 schools (16%) reported feeling that the tests were 
inappropriate. Reactions from staff in the other 2 schools 
(7%) could not be fit into the appropriate/inappropriate 
dichotomy . 
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Table 6-2 

Degree of CTBS and Local Curriculum Match 
(30 units at each grade) 



Local Curriculum Match 



CTBS Subtest 


None Little 


Moderate 


Lot 


Much 


NA 


?' 


Grade 2 Units 


Reading Vocabulary 


1 5 


6 


5 


7 


1 


5 


Reading Comp, Passages 


1 3 


10 


7 


6 


1 


2 


Reading Comp, Sentences 


1 3 


8 


8 


7 


1 


2 


Math Computation 


1 6 


9 


8 


3 


1 


2 


Math Concepts & Applic. 


5 


11 


8 


3 


1 


2 


Grade 5 Units 


Reading Vocabulary 


1 


5 


10 


10 


1 


3 


Reading Comp (General) 


2 


3 


12 


11 


1 


1 


Math Computation 


2 


6 


8 


12 


1 


1 


Math Concepts & Applic. 


2 


7 


10 


9 


1 


1 



*Unclear response . 



Staff in 26 schools (86%) reported that test adminis- 
tration conditions would lead to trustworthy results, while 
staff in 2 schools (7%) repo^-ted the opposite. Again 
responses from 2 schools could not be categorized. 

Turning Points in IGE Implementation 

This was an exploratory inquiry in the sense that it 
represents a byproduct of Phase II rather than a focus. 
There was, for example, no attempt to pursue the topic in 
depth or to validate any findings against outside measures in 
any formal way. The question may well be worth a survey in 
itself, especially to those interested in expanding and/or 
refining IGE implementation. 

Principals and others were asked to identify turning 
points in terms of "points at which problems to be overcome 
seem insurmountable and after which there is a period of 
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smooth ()f)eriition » " F'or (iiscussion purposes, the primary 
response of each school is included in Table 6-3; these break 
out into three distinct groups: (a) one-half the schools 
reported poirits or circumstances that were viewed as positive 
forces; (b) one-fourth reported negative points; and (c) the 
remair^der gave either an unclear response or reported no 
particular turning point. In connection ith the latter, staff 
members were unable to identify turning points. In some 
cases this was because they felt the program had always run 
smoothly or that it gradually ran smoother each year as they 
gained more experience with ICE concepts and implementation 
strategies; in other cases, this was because the ICE program 
was still facing problems and had not yet become a smooth- 
running operation. Certainly the school's perception of past 
and present status, along with its ability to identify key 
factors in the implementation process, affect the relevance of 
the responses provided. 

Schools providing any sort of direct response fell into 
two CcJtegorles: those who associated the turning point with 
the advent of a smooth running operation, and those who 
associated it with stagnation or decline of the ICE program. 
Within both categories there was a wide range of responses. 

One-third of the schools indicated a positive turning 
point associated with staff acceptance and implementation of 
the multiunit organization including full operation of the IIC. 
In five otfier schools, related turning points were associated 
with parent approval, successful delineation of curricular 
objectives, and the IPM. In connection with the latter— 
perhaps the only surprise in the data obtained — two schools 
reported that the turning point for successful operation was 
related to cutting back the initial ICE thrust. These staff 
members felt that the goals for implementation were set un- 
reahstically high for the first years, and the goals were later 
set at more attainable levels. Specific examples included 
dropping science as an ICE subject area, reducing student 
movement during the school day, and reducing emphasis on 
the IPM. 

Turning points associated with a decline in the ICE 
program also related to circumstances either at the outset of 
implementation or considerably later on. Several schools 
referred to influences outside the school, usually at the 
district level, as noted in Table 6-3. Staff at a few schools 
iruiicatcKi that tiie program was hurt by more internal prob- 
lenib, such as a unilateral decision to implement ICE without 
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Table 6-3 

Reported Turning Points in Implementation Sequence 



Number of 



Turning Polnta Schools 

POSITIVE 

Joint staff decision to go IGE 2 

Recruitment of good staff, removal of weak staff 3 
or UL 

Staff acceptance and implementation of multiunit 4 
organization 

Full operation of the IIC (its several roles) 1 

Parent approval and involvement 1 

Successful delineation of objectives in subject 2 
areas 

Reduced emphasis on IPM and multiaging 2 
NEGATIVE 

P made unilateral decision to ^o IGE 1 

Recordkeeping requirement 2 

Minimal training/assistance for staff at outset 1 

Mass reassignment of staff to subjects and grades 2 
(by district decree) 

Concurrent district dicta: narrow curriculum defined, 1 
no funds for inservice, reduced number of aides, no 
more student teachers 

Concurrent interactive factors: loss of aides, loss 1 
of planning time, reduced Board support, reduced 
staff commitment, greater costj 

Unclear 2 

None reported 5 
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staff support or the demands of the recordkeeping system. 
The impact of negative factors was sometimes in terms of 
multiple circumstances rather than single turning points. 

In the comparative analysis of high and low schools, the 
identification of turning points in implementation showed a 
clear difference between the two groups. The high group 
reported no turning points or only positive ones; the low 
group reported only negative turning points. 

Predictors of Success in IGE 

This question is highly related to the one just dis- 
cus,. ed. Again, Phase II reports represent a byproduct, 
since Phase II did not specify criteria in advance or focus 
special attention on this inquiry. Whereas turning points 
reflect school staff assessments of their history, the findings 
discussed here are restricted to RTI team judgments and 
general observations, in view of the literature and common 
knowledge about ICE, nothing reported here appears to be at 
all unusual or unexpected, but rather a reinforcement of the 
general wisdom about what Is required in order for any 
dramatic change in school practice to flourish and prosper. 

Phase II visit teams were unable to identify general 
Indicators of success or failure as an ICE school in one-sixth 
of the schools. 

In terms of success, the general indicators reported most 
frequently have to do with the school staff, for nearly half 
the schools including at least one of the following: a majority 
of the staff made a joint decision to initiate ICE in the school, 
or many of the school staff members displayed a willingness to 
work extra hours and work cooperatively in initiating and 
implementing the ICE program. Success is also attributed to 
individual student achievement and growth, substantial 
parental support, and continued inservice activities of a 
practical sort for learning and rejuvenation. 

In terms of failure, the general indicators again have to 
do with the sciiool staff, including one of the following in 
about one-third of the schools: a unilateral decision by the 
superintendent or principal to initiate ICE against resistance 
from, or without the participation of, a majority of the staff 
who were unwilling to devote time and energy in moving away 
from traditional [practices; or as time passed, decreasing 
attention ♦o student re-evaluation and regrouping, causing a 
return to practices characteristic of the self-contained class- 
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room. Other indicators of failure appear to be lack of leader- 
ship by the principal; changes in enrollment bringing about 
unfortunate teacher assignment changes; inadequate building 
and facilities; unionization; lack of cross fertilization with 
other ICE schools; and lack of actual individualization and 
application of the IPM. 

The comparison of high- and low-implementing schools 
was intended in part to determine whether special indicators 
exist in school ICE history that might differentiate the two 
groups. The two groups were virtually identical in the 
frequency and range of reasons for going ICE given by 
school principals and others. The same Is true for the initial 
implementation step, the kinds of assistance provided by the 
key originating agency identified by the school, and the 
range of personnel trained in the first two "major training 
events." 

Features of Implementation History 

Initial training from external agencies. Most schools 
noted the importance of initial training for any chance of 
success as an ICE school, and all but one reported some sort 
of formal initial training event for all or part of the school 
staff. There were many different resources for the initial 
training, such as states (SEA and SICC), teacher education 
institutions, various network agencies in the broad sense 
(HUB, intermediate agencies, district or diocese; facilitators), 
workshops conducted at or by the R S D Center, and work- 
shops conducted by district and/or school personnel them- 
selves. Staff members in many schools mentioned that the 
experiences associated with early awareness and training were 
vital to ICE implementation; when they were successful, there 
was good impetus for the program, and when they were 
ineffective, it was difficult for them to start the program. 

A major problem which was mentioned in many schools 
was that few staff members had received training directly 
from experienced personnel fully acquainted with ICE 
concepts, potential obstacles, and effective implementation 
strategies . Many of those interviewed felt that this had been 
'ci major drawback of the existing "networks" in the initial 
years of ICE (i.e., roughly 1970-1974). This observatior. may 
be interpreted as a school-level reaction to the training chain 
concepts implemented in the early years. 

Initiation of ICE at the local school. Schools reported a 
wide variety of "reasons for going ICE" (1-5 reasons per 
school), witli the large majority related to ICE concepts such 
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as differentidted sldffing, improved educational opportunity, 
predisposition of staff or building to the ICE patterns. Only 
a very few reasons (or schools) involved an irrelevant matter 
such as a district requirement. Appropriate motivations to 
join ICE were usually followed by obtaining a commitment 
through participation of the total school staff and district 
personnel, and sometimes such others as parents, the school 
board, a TEI, the Center, or a league. 

About two-thirds of the schools reported the early 
planning of the implementation of the seven components in a 
sequenced organized way, suggesting awareness of all seven 
and some realization of their interrelatedness. (Most of the 
remainder had no set plan for component sequence or could 
not report on this because of the time lapse involved.) 
Some, however, spparently expected to initiate the full ICE 
pattern all at once and very soon (within the first two 
months), while half the schools expected initiation of their 
plans to require twelve months or longer. 

The majority of schools reported a formal staff training 
event (2-5 days) before school opening for the year, with the 
remainder having one at or after that point. And while half 
the sample reported a second such formal training early in 
the Installation period, it was not the rule for the total staff 
to be involved or trained even across both such sessions. 
The basic content of these formal events concentrated on 
concepts and philosophy, management and planning, and the 
multiunit structure (ah important and necessary) at the 
expense of the IPM, instructional objectives, and curricula for 
implementation. Frequently these gaps were filled by sub- 
sequent staff development activities at the school or extra- 
school levels, but not all schools had (or recalled) such 
training. 

As schools looked back at their history, they noted that 
it took years to initiate the ICE components (compared 
with less than one year to 2 1/2 years in the initial plans). 
In ab( ut two-thirds of the schools, 6 or 7 of the 7 compon- 
ents were reportedly initiated in that period. In this group 
of schools, component 7, Research and Development, was 
consistently either the last to be implemented or not yet 
implemented as of spring 1978. The other somewhat consistent 
patterns were for the Multiunit Organization to be initiated 
first and for the IPM to be initiated fifth or sixth in the 
sequence. 
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Current ICC staff development . Two-thirds of the 
schools make some provision for new staff to become 
acquainted with ICE, depending as a rule more on informal 
than formal approaches and most often schec?uled before 
school opening or within the first month ^ The informality of 
this training, plus the fact that just ove'r one-third of the 
schools had a 1977-78 preschool workshop (o*' equivalent), 
suggest the somewhat minimal extent of "annual ICE renewal" 
in the Phase II sample. 

While the schoolwiJe inservice training is frequently well 
organized, related to ICE components, based on staff needs, 
and scheduled on a regular basis, the Phase II teams nonethe- 
less took away the impression that such training was often 
not adequate to staff needs (in terms of time or content) or 
was approached more as general than as ICE inservice. 

Patterns in implementation history. As the specific data 
and the discussion above are studied, several patterns in 
implementation history — at least so far as the Phase II sample 
is concerned — can be discerned. These are outlined below, 
some in relation to school practice and some in terms of the 
larger ICE context. 

1 . From the schools' viewpoint and in connection witfi 
specific evidence available, considerably more technical 
assistance, basic information, and training were available in 
the early years of ICE installation than in recent years or at 
the present (1978). 

2. Similarly, recourse ihe networks (at all levels, but 
principally the state leveH, and network-Initiated assistance 
in installing new ICE schools as well as in helping established 
schools to refine ICE, has diminished. 

3* While virtually all schools reported one initial formal 
training event (and half reported a second) plus various 
amounts of ICE-related inservice training during the first 
installation year, the amount of such inservice had reduced 
markedly by 1978. This appears to hold true for "inservice 
in general" as well as for strictly ICE-related staff devel- 
opment activity. 

a. Similarly, the level of self-direction appears to have 
diminished over time. This relates to commitment, use of 
implenientation criteria, self-assessment, planning, adherence 
to the basic concepts, seeking outside resources, and so on. 
The actual level of commitment and ICE activity reported in 
Phase II suggest a reduced level of implementation in many 
schools and a certain stagnation in a few others. 
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5. The home-School-Community activity, perhaps given 
heightened importance in the first year or two, does not 
appear to enjoy recognition as an ICE component or to be 
given special attention beyond the sorts of communication that 
most schools engage in. 

6. Similarly, while a good deal of attention was given at the 
outset to the 1PM and a good deal of activity has revolved 
around it, this component has not emerged as either a special 
input or notable output of ICE in practice. It seems not too 
well understood by many staff members, and whero it is 
understood and accepted there are often obstacles such as 
lack of aides, loss of unit planning time, reduced willingness 
to engage in detailed recordkeeping. 

7. The range and frequency of reported impacts/conse- 
quences are about the same for the initial period as for the 
current period, in terms of both positive and negative im- 
pacts. Both negative and positive outcomes continue to be 
reported up to the present (1978), including strong positive 
outcomes in a number of schools in this sample. 

8. In practice, among Phase II schools, "ICE" appears to 
have changed somewhat from a comprehensive attempt to 
achieve an integrati>d instructional and organizational milieu to 
a way of denoting either the use of certain types of curricu- 
lar materials or a coordinated attempt to accomplish some level 
of individualization. In the process of change, the IPM and 
its technical schema--ihe very heart of ICE conceptually — 
appear to have been replaced by the multiunit organization as 
the most identifiable aspect of ICE at the same time that some 
individually guided education continues to be implemented. 

It seems reasonable to infer that these patterns are 
interrelated. The existence and availability of outside re- 
sources, for example, will affect their value and utilization, 
and in turn this will influence the school's perception of its 
goals, its status, and its potential level of success — as well as 
its actual efforts in effecting change or accomplishing indi- 
vidually guided instruction. 

Staff Agreement with IGE Concepts 

In view of much that has already been reported about 
staff awdreness and commitment, it is reasonable to theorize 
that considerable variation in staff attitude would obtain along 
with meaningful differences in their assumptions about educa- 
tional practice. 
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The Phase II visit teams reported that the consistency of 
staff attitudes with respect to the concepts underlying ICE 
falls Into three categories: (I) a great majority of the staff 
members in about one-third of the schools had attitudes very 
consistent with the concepts underlying ICE; (2) in about 
one-half of the schools, there was a good deal of consonance, 
but either a significant number of the staff did not have 
attitudes consistent with ICE concepts or the school did not 
implement certain components of ICE; and (3) in the re- 
mainder of the schools, there was overall a lack of con- 
sistency with regard to ICE concepts. When these judgments 
were reduced to a simple Yes-No rating for the overall staff 
attitude and acceptance of underlying ICE concepts, the 
result was Yes, 23 schools, and No, 7 schools. It seems 
clear, however, that some of the Yes judgments are moderated 
by the recognition that the majority of school staff accept 
IGE-IIke concepts but do not (or have not yet) put all of 
them (or even the most important of them) into practice. 

In the schools exhibiting the most consistency, it was 
sometimes noted that there was a great deal of staff unity or 
that the staff was young and vigorous. It was also fre- 
quently true that new teachers were required to undergo 
preservice orientation or that many of the teachers had 
served as student teachers or interns in ICE schools before 
teaching in their present school. 

Of those schools showing a lack of consistency with 
regard to ICE concepts, most included some staff members 
who have attitudes consistent with ICE concepts but these 
people were definitely in the minority. There was also 
generally a great deal of variation in attitudes and practices 
across Units, with ICE practices also in the minority. 



In more than half the schools, the teams concluded that 
there was strong evidence of cooperative planning regarding 
the instructional program at the Unit level. In most of these 
schools, cooperative planning was evidenced in instructional 
manjgement, staff differentiation, and providing for con- 
tinuous student progress. In the remainder, staff differen- 
tiation appeared more firmly entrenched than did continuous 
progress. 

In about one-third of the schools, there was some 
evidence of cooperative planning at the Unit level, with little 
or no leadership and coordination across the Units. In some 
of tlicse schools, a moderate level of cooperative planning 
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took place in all Units, while in others it appeared in only 
some Units. 



In the .emaining one-sixth of the schools, there was 
almost no evidence of cooperative Unit planning regarding the 
instructional program. In these schools there was no func- 
tioning lie to exert leadership or to provide coordination. 
Although there was some evidence of either staff differen- 
tiation or continuous student progress in individual Units, the 
efforts were weak, and they failed to have a significant 
positive effect on the overall school instructional program. 



Two general approaches were taken in exploring IPM 
implementation. One was to observe, interview, and study 
materials in Units 2 and 5 in an attempt to synthesize IPM 
elements and determine whether or not they comprised the 
classic IPM or possibly some variant of it. This "new in- 
formation" task proved difficult to accomplish because of the 
variable Unit structures, and the many staff members who 
were not conversant with IPM operations or concepts. The 
second approach was to attempt to verify the accuracy of 
reported ICE subjects througli discussion of schoolwide 
objectives and recordkeeping activities. This validation task 
also proved difficult because various subjects could not be 
followed up in all Units and because what looked like school- 
wide practices in fact were often limited to certain Units (or 
even parts of Units). In addition, designation of ICE sub- 
jects by principals was influenced by variable local definitions 
of certain curricula, resulting in confusion over just what was 
and was not a discrete ICE subject. 

The IPM component — with its instructional objectives, 
status measurement, recordkeeping, continuous progress, 
grouping, instruction, and staff planning — was discussed 
throughout the complete Phase II report in different contexts. 
Unit definitions of specific instructional objectives were noted 
along with the finding that, in half the sample, schoolwide 
objectives apparently do not exist for certain subjects as 
criginally reported, resulting in variation in IPM imple- 
n.entation at tfie Unit level. Similarly, staff reactions to 
assessment, grouping, and recordkeeping were reported, 
revealing somewhat limited practices and somewhat restrictive 
attitudes. The fact, too, *hat many Unit 2 and Unit 5 
teaciiers described their typical instructional modes as 
classroom groups within the Unit — combined with the finding 
that many "Unics" exist more as convenient administrative 
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entities than as instructional groupings— suggest a milieu in 
which it would be difficult for a strong Implementation of the 
IPM to occur. It would be difficult to describe what is 
typical, because overall the IPM appears to be either poorly 
understood or partially implemented, and in a significant 
number of schools the 1PM takes second piace to the priority 
placed on the multiunit organization. The 1PM itself has 
several interrelated elements, and it Is not always easy to see 
all of them operating conjointly at the school or Unit level 
especially where the model does not appear to be perceived as 
a unified whole. 

It is clear, however, that the IPM can function in small 
groups {such as multiaged or single-aged self-contained 
classrooms) and Phase II gives ample evidence of this, A 
number of committed teachers operate in the iPM mold in one 
or two subjects—in their own contained classrooms, in their 
personally developed subunits with some cooperation from one 
another teacher or in other situations. And while a few 
schools follow the IPM in a highly professional way in multi- 
aged Units and in three or even four subjects, this is not 
typical for Phas^ 11 schools. Inasmuch as the classic IPM is 
expected to work best where it is adopted schoolwide and 
where the total staff teaching multiaged groups of children is 
both cognizant and committed, these isolated cases of positive 
Unit autonomy may not be as effective as desired. 

Refinement and Renewal Attitudes 

The Phase 11 visit teams found many positive indications 
of pride in the school program and a general recognition of 
things well done in about two-thirds of the schools, irre- 
spective of ICE status. They also found active seeking of 
improvement in about one-third of the schools, including 
general efforts across the school program and specific efforts 
such as staff cooperation on curriculum development and 
revised student reporting systems. These feelings of pride 
and accomplishment as well as efforts toward improvement 
were not limited to ICE elements, however. They included 
overall school programs with their unique adaptations of ICE 
components, and applied in one or two cases where ICE is no 
longer recognized. It would likely require a case-study 
approach to these schools, with all that implies, to examine 
this whole question definitively in terms of ICE status, 
renewal, and refinement. 

Of tfie remaining one-third of tfie schools, some general- 
ly accepted the btijtus quo while a few others almost totally 
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lacked pride in the educational program and were making little 
effort to improve. Again, this applied to the overall school 
program as well as to ICE operations. 

State Network Benefits 

For purposes of this question, network is defined broad- 
ly to include state networks, leagues, PACTs. HUBs, and any 
other such organizations outside the individucil school — with 
emphasis on the state-level organization but also conceived as 
the total matrix of such resources. 

About one-third of the schools reported that they cur- 
rently receive some positive benefits from the network in 
general or view the network as an important source both of 
materials and enrichment. Among the specifics mentioned 
were: statewide ICE conferences; newsletters; regional, 
league, or other inservice or "sharing" meetings from time to 
time; joint activity (within a league) at self-evaluation; AlCE* 
as a ''supernetwork" in relation to annual conferences; trad- 
ing ideas on curricula; general and specific courses at TEls. 
Overall, however, when specific benefits were mentioned, 
they more often related to networks at regional or local levels 
than at state levels. 

There was some indication tha!: networks had been very 
important in initiating ICE a few years ago, but that they are 
much less activij in recruiting new schools or in providing 
enrichment and rejuvenation to "old" ICE sciiools at the 
present time (1978). In addition, there was some concern 
that networks have been losing their funding resources in the 
recent past, causing personnel to be switched from facilitator 
roles at the SEA level. A few respondents felt that these 
trends will hurt ICE severely, since ICE extension to new 
schools will be limited, and present ICE schools may abandon 
the movement because of the lack of technical assistance and 
refinement activities. In one state where two schools were 
visited, both principals mentioned the efforts, in spring 1978, 
to recreate a regional league network, since they felt it was 
indispensable to continuation of any level of ICE implemen- 
tiition. 
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Cost of IGE 



This topic was discu ',sed directly and indirectly in 
interviews at all the schrols, with e.nphasls on "Does ICE cost 
too much?" as wtll as ''Is ICE worth it?" to evoke both posi- 
tive and negative i tactions. 

When staff responded in terms of budget, about two- 
thirds of the schools stated that ICE involved either no 
additional monetary costs or minimal additional costs, at least 
at the present (1977-78). In terms of time and energy, staff 
in these schools indicated that ICE requires greater amounts 
than traditional programs but is worth it. Many of these 
schools gave specific examples of the benefits gained from the 
extra time and energy devoted to ICE: increased student 
achievement; teacher cooperation and iharing; better student 
climate in terms of responsibility, growth and discipline; and 
personal and professional growth of teachers. 

Staff in about one-third of the schools stated that ICE 
does require too much commitment, in terms of money, time, 
and/or energy. In most cases they continued by stating that 
ICE was really not being implemented in the schools, in spite 
of its potential. 

In addition to the general observations above, visit 
reports were analyzed for school perceptions of costs and 
savings involved in ICE implementation, across the total 
period to the present. Table 6-4 outlines the specific 
findings across all schools. In the upper block, the overall 
perception of minimal cost or minimal saving is reported for 
each school. In the lower block, specific costs or savings 
are I'sted; this block is set up so that roughly equivalent 
categories may be contrasted as perceived costs or savings. 
While monetary matters were mentioned, they were less fre- 
quent overall than other types of entries, and notably less 
frequent in the minimal savings column. Conversely, 14 
schools mentioned minimal costs in terms of actual dollar 
output and use of community personnel resources. Overall, 
there are 21 reasons for minimal savings among the 13 schools 
responding with specifics, and 26 reasons for minimal costs 
from the 17 schools providing specific responses. 

On balance, this sample of schools — irrespective of 
current ICE implementation status--judged that IGE is more 
worthwhile than not in terms of the costs of time, money, and 
energy and perceived more specific savings than costs asso- 
ciated with ICE. 



ERIC 



123 

132 



Table 6-4 

School Perceptions of ICE Cost and Savings 





Number of 




Number of 


Cost 


Schools 


Savings 


Schools 



Overall perception: One 


response per school 


None, minima.l 


10 


None, minimal 


6 


Reasonable, a little 








(general) 


9 






Unclear response 


3 


Unclear response 


5 


No response 


2 

• 


No response 


2 


Reasons for minimal cost/savings 


Multiple responses allowed 


Share materials; less to 




Cost! for instructional 




buy 


8 


materials 


3 


Less cost for substitutes 


1 


Salaries for aides 


5 


More community resources 








used (parents, retired 








teachers, other 








volunteers) 


5 






More efficient use of 




Workload on staff (some- 




teacher time (teacher 




times means reduced 




planning) 


2 


morale) 


6 






Maintaining staff 








commitment 


2 


Better staff morale 


2 


Rivalry between IGE and 








non-IGE staff in the 








school 








Resentment in non-IGE 








schools 




Student responsibility, 




Attribution of disci- 




less vandalism, better 




pline problems to 




discipline 


3 


IGE 




Better community attitudes 




Time to persuade commun- 




re education 


1 


ity of IGE value 




More efficient use of 




Time for league 




principal's time 




activities 




(more on instruction) 


2 






Better education for the 








same money 


2 
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CONCLUSIONS AND IMPLICATIONS 



While some of the implications and strictly judgmental 
observations below may properly be applied broadly to ICE, 
the conclusions themselves relate to the particular sample of 
schools studied in Phase II. It is emphasized that among the 
criteria employed in sample selection was inclusion of schools 
with higher and lower implementation status according to 
self-report data supplied in Phase 1. As a result, the find- 
ings and the conclusions derived from them reveal a signifi- 
cant "spread" in ICE perceptions and practices rather than a 
common set of findings that might describe what is typical. 

/. Phase II validation findings may be applied to Phase I 
more as aids to interpretation than as recommendations 
specific to Phase I variables or analysis. 

This conclusion is related not only to the nature of 
somewhat equivocal findings but also to the nature of the 
inquiry. Where direct confirmation of Phase I data is con- 
cerned, the overall findings show a greater amount of verified 
data than of data not verified, but they also reveal some 
serious concern with particular Phase 1 items as well as with 
respondent attitudes in some cases. The inquiry itself must 
also be considered in that it involved a select sample of 
schools and included Sn array of validation items related to a 
select group of Phase 1 variables. 

One might note that a number of "new information" 
topics expand on what was obtained in Phase 1 (re history, 
inservice, originating agencies, networks), irrespective of the 
validation task. These data cannot be applied directly to 
Phase 1 variables or analyses (having been obtained for a 
select sample), but they can "advise" interpretation of the 
strength of the variables in effecting Phase 1 outcomes. In 
that sense, there is a clear conceptual relationship between 
the validation and "new information" tasks as they relate to 
Phase 1. 

2. A variety of factors affected the utility of data gathered 
by the Phusv I instruments. 

In the majority of schools. Phase 1 data reflected an 
adequate to strong sense of reality with respect to ICE imple- 
mentntion ond the particular organizational and instructional 
practicob engaged in. In the majority of schools, too, it 
appeared t^iat staff members answered carefully and honestly 
and attempted to follow the Phase 1 directions and proce- 
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dures. Across the Phase II sample of schools, however, 
staffs indicated a number of factors that made completion of 
the Phase I self-report questionnaires somewhat difficult and 
resulted in some responses they did not feel entirely com- 
fortable with. These factors included such matters as con- 
fusion over directions, staff resistance, differential appro- 
priateness of items to the local ICE situation, fatigue, 
inconsistent within-school responses, nonparticipation by some 
staff, differential bases for rating implementation status, 
length and complexity of items or instruments, and ambiguity 
within items. While the intent in most all schools was to 
cooperate, to assist the evaluation, general and local cir- 
cumstances tended to reduce the expected meaningfulness of 
the questionnaire data. There was also apparently some 
special difficulty with the Implementation Survey as a whole, 
in addition, the final status of the verified ICE School Survey 
suggests some confusion over ICE terminology as well as 
incomplete or inaccurate responses to basic descriptive items 
at the school level. 

A related factor is that a significant number of schools 
no longer appear to be ICE schools or are ICE only partially — 
and a general sense that ICE is not the paramount motivator 
or touchstone of the educational program in fnany of the 
sample schools. 

Student achievement and affective testing appears on the 
whole to have been conducted appropriately, and the great 
majority of respondents indicated that they would trust and 
use these outcomes. The usual careful approach to testing 
was lil<ely enhanced by the aura of formality and importance 
typically attached to standardized measures by both students 
and school personnel. 

3. The several ICE components are differentially understood, 
valued, and implemented in the Phase II sample. 

It is not the rule for school people (including principals 
and unit leaders) to think of ICE in terms of components or 
of seven given components. And, among trie seven stated 
eleriiLMits, there is a rougfi [lierarchy of awareness closely 
related to extent of implementation. Although about equal 
emphasis on the Multiunit Organization and the Model for 
Instructional Programming for the Individual Student (IPM) 
wds reported across schools, the Multiunit Organization 
appears much better understood and implemented than the 
IPM. Indeed, most principals and many teachers seem to feel 
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now that the heart of ICE is the Multlunit Organization (with 
shared decision-making and more open communication) irre- 
spective of the level of IPM implementation. 



Aside from the Multiunit Organization two other com- 
ponents are tied quite firmly to the schools' overall concept of 
ICE, Curricular Programs and Facilitative Environments (more 
as a set of helpful circumstances than as integrated compon- 
ents of a larger system). Home-School-Community activities 
are also widely engaged in and valued—and received emphasis 
in the installation period—but in many schools these are not 
viewed as aspects of a component per se. Of all the compon- 
ents, Research S Development seems to be understood and 
implemented at the lowest level across schools, 

A good deal of effort—more in the past than at present- 
has been expended in connection with the IPM component, but 
with only moderate success overall. There was considerable 
evidence in Phase II of "partial IPM-ing/' of variations within 
and across units, of employment of the full IPM for some 
students but not others, and of emphasis on some steps in 
one curriculum but not another. Frequently this somewhat 
inconsistent approach resulted in an emphasis on and a valuing 
of some form of individualization but not necessarily the whole 
IPM sequence. 

^. The historical patterns that emerge in the Phase II sample 
suggest a decline in implementation energy, availability and 
use of outside resources, and adherence to basic IGE 
concepts. 

There are data of record as well as the perceptions of 
school people which indicate that the several originating 
agencies and the networks at various levels provided a good 
deal of impetus for ICE implementation several years no, 
developed training chains, organized resources for technical 
assistance and mutual support, and in other ways aided the 
implementation/maintenance processes. At the same time these 
resources have apparently declined either in actual existence 
or in importance, there has been some evidence of a decline 
in IGE bootstrap attitudes, in acceptance of the more demand- 
ing IGE concepts and components, in staff development re- 
lated to IGE, and in affiliation with active rietworks— at least 
so far as this sample is concerned. If there is a demon- 
strable relationship here, it is not a surprising one since 
most ICjL scIu)o1s report a need for contact with and support 
from a larger IGE context of some sort. 
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Tflis conclusion is drawn from the total sample and the 
apparent overall patterns. But within the sample, there are 
strong ICE schools with a high degree of independence and 
self-sufficiency; schools which continue to attempt improve- 
ment with whatever resources are available; and schools which 
value ICE for what it has accomplished and saved and generated. 
There are also schools where adherence to the IPM is clearly 
evident and where cooperative planning at IIC and Unit levels 
is effective. 

5. Certain predictable factors appear related to overall ICE 
status and success. 

Direct and indirect findings in Phase II reinforce 
"common knowledge" about the sorts of historical ^actors 
which relate to later fiealthy or declining ICE status. 
Particular facets of a well planned installation period (such as 
staff commitment, curricular objectives, parent approval) 
dppe<^r to augur well for later strong ICE status or at least a 
smooth operation. On the other end, schools recognized that 
unilateral decisions to go ICE or insufficient training at the 
outset appears to relate to later decline or stagnation of the 
ICE effort. Thus, a number of specific turning points were 
stated by school personnel themselves and seem closely re- 
lated to present (1977-78) judged status of ICE implementation 
at least in the broad sense. 

6. Useful data on "new information" topics can be obtained 
via refinement of data-collection methods. 

Regardless of the specificity of the topical outline and 
Team Visit Report Form, the conditions of a brief field visit 
did not always permit obtaining the full extent of data that 
might be needed for some research purposes. Exploration of 
these areas would be enlianced — depending on research needf. — 
by surveys specific to certain topics and/or by clearcut 
case studies of a longitudinal nature. 

7. Some form of annual c sessmcnt of ICE status, operations, 
and Lommitmcr)t is important r)Ot only for research and 
accountif)g purfjoscs but also as a means of enhancing new 
and refined implementations . 

In view of a niimber of observations based on Phase II 
as w^}!l general awareness of HE, an annual monitoring or 
tjccountifiy activity is seen as a near necessity in order to 
keep the movement alive and healthy. Such an activity 
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should be national in scope and should be approached cross- 
sectionally as well as longitudinally in order to accomplish 
several related purposes and to make use of a broad spectrum 
of resources. 

8. The multiunit organization of ICE schools is fluid and 
affects operations as well as the description and evaluation of 
those operations. 

Historically, it appears that ICE concepts, implementation 
plans, descriptions, and evaluation efforts have defined or 
assumed the school as the locus of operation and the focus of 
study. The model's paradigm supports this interpretation 
with Its reference to the IIC and several Units equal in their 
mal<eup and their relation to the IIC. And while departures 
from this model are no doubt expected, perhaps encouraged. 
Phase II findings suggest that implementation is so varied as 
to affect the l<inds of data obtained in Phases I and II and 
the interpretation of some of those data. The variations 
occur with regard to subjects, schedules, multiaging, group- 
ing strategies, planning, grades, use of tha IPM in part or 
full, or any combination of these. 

9. Implementation variables lead to a question of what ICE is 
and meK is. 



Among many school people as well as Phase II visitors a 
question often arose—What is ICE?--and this appears to be a 
legitimate question. In a sense, ICE is whatever occurs 
under its name, but this is often quite different from the 
models disseminated by the originating agencies. So far as 
the Phase II sample is concerned, !CE is more recognizable as 
a form of the multiunit organization along with facilitative 
environments than as an implementation of the instructional 
programming model. 

However, what may be described as ICE (or partial ICE) 
schools do appear to have something in common. This is an 
effort to accommodate individual students, to engage in some 
form of individualizeri instruction. In pursuit of individual- 
ization or personalization, these schools as a group have 
broken the lockstep of strictly graded self-contained class- 
rooms and single-teacher instruction, although this is some- 
times evident in only a portion of the school or in the work 
of a few dedicated teachers or for one hour a day four days 
a w».->k. In the Phase II sample, a certain movement can be 
seen from the old to the new, and frequently ICc has been 
adopted or adapted or borrowed from in an effort to find 
operational ways of implementing "new" ideas related to the 
individualization of instruction. 
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10. The full ICi model may never be ottained and may not 
be attainable. But some moderate level of implementation may 
be sufficient to describe ICE and to accomplish its objectives. 

It is quite apparent that all the ICE components and 
outcomes can be and have been implemented — but not neces- 
sarily in the coherent integrcjted fashion that was intended. 
At the same time, many schools have moved beyond the 
traditional mode, adopting certain important ICE practices and 
effecting a degree of individualized or individually guided 
Instruction, At this juncture, it may be useful to consider 
what ICE Is and does in a normative way and to redefine ICE 
In terms of what is most attainable and stiil comes closest to 
the "ideal," 

It is conventional wisdom that a certain amount of "over- 
reach" is either necessary or desirable when institutions 
attempt to make broad meaningful changes. Many iCE schools 
appear to have aimed high and fallen somewhat short, settling 
into a locally feaslL.'e adaptation of ICE that may be '^ss than 
the ideal but at the same time is more than the traditional. 
Other schools have edged slowly up to that same level. In 
either case, the basic ICE concepts are not necessarily lost or 
devalued. They are redefined. And the difficulties involved 
in either sort of attempt can be — and often are — viewed as 
valuable as well as necessary. They help schools to decide 
on the minimal elements that represent their goals; to alter 
the model's goals and components to fit with reality; to choose 
their priorities within their resources; to accomplish some 
level of individualization. 
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CHAPTER 7 




What values and meanings are transmitted by reform 
programs in schools? This report, drawn from a more de- 
tailed discussion of the use of Individually Guided Education 
(ICE) in six schools reported to be exemplary ICE schools 
(Popl<ewitz, Tabachnick, 8 Wehlage, 1982), addresses this 
question in a manner which reveals more than the conclusions 
of a single research effort. This summary chapter considers 
the development and implementation of ICE in a network of 
social and political relationships involving students, teachers 
and their aides, parents and other community members, school 
and district administrators, and the ICE designers. Its con- 
clusions, rather than simply evaluating the match between 
Intention and outcome, create a less conventional focus for 
the study of what is intended and unintended, for what was 
expected to change and what was changed. 

As a systems approach to the reform of schooling, ICE 
was intended as a comprehensive program coordinating re- 
search and development, teacher training, curriculum mater- 
ials, school administration and district practices, and home- 
school relationships, as well as student and teacher beha- 
viors. ICE'S designers believe that by applying the prin- 
ciples of educational psychology through a systems approach 
the objectives, variables, and interrelationships of an 
educational environment can be known and can be structured 
to yield efficient learning. The procedures of ICE are 
assumed to be universally applicable to any and all school 
settings and are believed to be a neutral, nonideological 
technology capable of reforming all elementary schooling. 

The iCE program embodies at least two attitude? found ^ 
in the currents of American educational thinking. One of 
these is the belief that individualism is important and that the 
development of individual talents and interests is a significant 
goal of education. The individualization of instruction caw be 
seen as a contemporary response to the perception that 
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schools have failed in their responsibilities to the IndivicluaL 
The second attitude involves the assumption that important 
social problems, such as the education of youth, are most 
effectively attacked through the power of scientific expertise. 

ICE is unusually attractive to many school people be- 
cause it links the appeal of individualism with the harmony 
and efficiency of scientific management. Systems management, 
behavioral objectives, and criterion-referenced measures are 
backed up by research on individual cognitive differences and 
needs. The unitized school and the Instructional Program- 
ming Model combine systematically to provide for students who 
learn at different rates and in different ways; by offering 
varied groups and materials as different routes to specified 
objectives, this system appears to be responsive to different 
learning styles. Giving teach'Srs the decision over which 
Individual objectives children should achieve is intended as a 
response to the cultural, social, and personal differences that 
children bring to school, as well as to the different interests 
and expertise among teachers. Individualism and scientific 
management blend to bring coherence to the social purposes 
of schooling. 

As instituted in the elementary school, however. Indi- 
vidually Guided Education's reforms extend beyond the systems 
analyses and management procedures of its program. Implicit 
in Individually Guided Education are values and assumptions 
about social change and control which remain tacit, even as 
concrete proposals to intervene in the social world are devel- 
oped. To understand Individually Guided Education, these 
tacit assumptions and values, which define the reform and 
make it feasible, must be systematically investigated, and the 
relationship of the reform technologies to the ongoing norms, 
beliefs, and values of schooling must be made explicit. 

Our intent in this study, then, was to make problematic 
the assumptions and procedures of Individually Guided Educa- 
tion: to describe the implicit as well as the explicit learning 
which occurs when students, administrators, and teachers 
respond to an educational reform, and to examine how the 
technologies of IGE are incorporated into the continuing social 
and poliLical context of schooling, and thereby receive mean- 
ing. Our investigation provides a framework in which more 
general theoretical questions about the assumptions, impli- 
cations, and consequences of institutional life and change can 
be raised. We will discuss school interactions, work pat- 
terns, and the relationships between schools and their com- 
munities to illuminate the rules, social values, and interests 
that influence different school practices. 



132 



ERIC 




Our intent Is r^ot only to describe the perceptions and 
actions of people In schools, however; we are also concerned 
with the underlying assumptions and social values implicit in 
school p'actices, and how they affect the realization of reform 
technologies. The everyday activities of schooling and its 
reform are placed within contexts of larger social, Intel- 
lectual, and ideological concerns. 

This summary proceeds in the following manner: after a 
brief consideration of methodology, discussion turns to the 
problems of reform in an institutional context and to con- 
sideration of Individually Guided Education as social in- 
vention; next, the three conditions of schooling — technical, 
constructive, and illusory— are introduced and described; 
finally, these three institutional configurations are related to 
the ways educational reform is conceptualized, researched, 
and implemented and the assumptions about the nature of 
school change as a neutrai and technical endeavor are 
examined. 

This Investigation of Individually Guided Education, 
reform, and institutional life was designed to complement the 
more conventional evaluation of the other phases of the eval- 
uation effort. The approach taken was to study six ele- 
mentary schools that had been nominated as exemplary IGE 
schools. Nominations were solicited from people reputed to be 
knowledgeable about IGE including Center staff who had 
worked with various schools to implement the program, 
individuals in state education agencies who had first-hand 
knowledge of IGE in their states, and individuals who had 
worked at implementing IGE at a variety of sites. Seventeen 
schools were visited for two days each by two people. Four 
of these schools were selected for the study. Two additional 
sites, not among the original 17, were added later. 

This research effort was a four-year project. Our first 
concern was to place the IGE program in a general context of 
school reform and institutional life — to establish the program 
as a particular case of educational change and reform from 
which theoretical idsights could be derived. We then sought 
to understand what the planners of IGE had written about the 
program; our intent was not to use the definitions and cate- 
gories of the planners in our field research, but to under- 
stand how the program had emerged historically, and what 
assumptions and implications about educational practice 
underlay the thinking of its designers. To gain firsthand 
knowledge of how practitioners around the nation talked about 
and implemented Individually Guided Education, we initially 
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paid two-deiy visits to each of 17 schools which had been 
reported to be exemplary IGE schools. From these schools we 
selected five in which, in the second year, intensive case 
studies were carried out; a sixth school was added to the 
investigation in the course of the field work. Each school 
was visited for data collection on at least three separate 
occasions. 

The last two years of the project involved analysis and 
writing. As our research progressed, we had encountered 
fundamental variations in the conditions and social implications 
in the six schools studied, as well as different institutional 
responses to the technologies of IGE; to describe these varia- 
tions and their significance, we created three categories: 
technical, constructive, and illusory schooling. The cate- 
gories are related to Wittgenstein's concept of family re- 
semblances; the schools in each category have overall 
similarities and overlapping characteristics, but the categories 
should not be considered as qualitatively identified or de- 
termined. 

Before discussinp schools as institutions into which 
reform programs are introduced and the elements of insti- 
tutional life, a comment on methodology is appropriate. 
Analyses of research ofton separate discussions of reform and 
institutional life from discussions of methodology, making the 
choice of investigative procedures seem a purely technical 
act. We believe, in contrast, that problems of methodology 
cannot be considered adequately without referring to the 
questions, theories, and Intellectual traditions that make 
particular investigative strategies plausible. Data and 
descriptions of social conditions are not presented in a 
vacuum, but are inevitably tied to theory. A study of 
educational reform, therefore, involves the complex and 
profound relationships of reform, institutional life, and 
methodology . 



Social institutions perform certain agreed-upon functions 
to achieve social goals. The mandate or function of schooling 
is to provide a formal social structure within which children 
ciro to prepare for adulthood. Schools define and legitimize 
categories of competence in society, provide publicly accept- 
able classifications of people and knowledge, and give access 
to valued positions in society. While it is important to 
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recognize that schooling Is given legitimacy because it has a 
social mandate, that charter cannot be taken for granted. 
Most Americans accept the mandate on the grounds that 
schools should "prepare children for a democratic society/' or 
that people should "be taught to think for themselves/' but 
these slogans have many possible interpretations. Some may 
view the school mandate as a call for providing individuals 
with opportunities to develop their own intellectual capa- 
bilities, expressing a classic liberal faith in the individual's 
ability to contribute creatively and imaginatively to public 
life* Others may see schooling as preparation for entering a 
social world already classified and organized according to 
certain occupational and status lines (Popkewitz, 1981). 
Inherent in each interpretation are different social values and 
implications for school practices that are obscured by slogans 
about the social mandate. 

The conflict between definitions of social purpose directs 
our attention to a second aspect of schooling— the actual 
values and beliefs sustained In day-to-day school life. Like 
all institutions, schools function according to rules and 
procedures which give coherence and meaning to everyday 
activities and interactions. Such rules and procedures are 
embodied in regularized patterns of behavior, specific vocabu- 
laries (a child in school is a "learner," his or her learning is 
"achievement,*' and so on), and particular roles (teacher, 
pupil, or administrator). So potent are institutional patterns 
that the social structure experienced In schools channels the 
thought and the action of participants, giving definition and 
meaning to both school reform and pedagogical practice 
(Popkewitz, 1979). 

While making this argument, we do not wish to present 
an overly socialized, deterministic view of the individual. 
Institutional life can respond to and be shaped by the people 
who participate in it. However, we cannot pretend that 
contemporary forms of social life are not potentially coercive. 
Our definitions of social conditions and our expectations are 
created by past and present patterns of action and belief 
which limit the possibilities for change, or at least restrict 
the options for making modifications. 

In considering the effects of ICE as a reform program, it 
is important to look beyond its language of individualized 
instruction, team teaching, and nongraded teaching units. 
The ICE model carries with it certain assumptions about the 
nature of kr^owledge, the most effective ways children can 
work to gain that knowledge, and the role of the professional 
staff in implementing the reform. ICE was conceived as a 
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systematic altenipl to reform schools; it was also designed as 
a comprehensive program affecting both agencies external to 
the school and structures within the school. There is a 
pattern, therefore, of interrelated assumptions that give ICE 
form and content. Our understanding of institutional life, 
and of the effects of reform, may be clarified by considering 
these important dimensions of schooling — knowledge, work, 
and professionalism — and the relations among them. 

Conceptions of Knowledge 

Schools are places where conceptions of knowledge are 
distributed and maintained; implicit in this discourse are ways 
of reasoning and communicating about social relations, social 
conditions, and social authority. The authority of an insti- 
tution to channel thought and to define human conditions has 
subtle implications for the way knowledge is conceptualized 
and hints at the underlying patterns of thought found in 
schooling. Carl Becker (1932) suggested that rooted in the 
everyday life of each age are certain preconceptions, beliefs, 
and/or value structures that give direction to social thought. 
The medieval assumption, for example, was that of existence 
as a cosmic drama, written by Cod, and embodying a central 
theme and ri>tional plan. 

Today, however, a number of assumptions compete for 
dominance. The laws of Cod, and of nature, have been 
challenged by existentialists, liberals, and Marxists. From 
such a plurality of ideas, problems of choice arise that are 
compounded by the institutionalization of education. Schools 
selectively impart cultural traditions and concepts of knowl- 
edge; and curriculum, instruction, and evaluation direct 
students toward specific uses of intelligence and a particular 
kind of reasoning about ideas and action. The concepts of 
knowledge that are distributed in schools, then, become 
problematic when we view curriculum, instruction, and eval- 
uation as having social as well as intellectual content. 

Schools as Places of Work 

Schools are also places of work where students and 
teachers interact to alter and improve their world, establish 
social relations, and realize human purpose. The activities of 
students and teachers in schools collectively form a pattern of 
work (Popkewitz & VVehlage, 1977). However, school work 
should be considered in relation to human work in general. 
Work is fundamental human activity by which people establish, 
modify, and carry out cheir social purposes. An important 
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aspect of work is thu relation of thought and imagination to 
the products of human labors (Braverman, 1974): worl< not 
only affects the form of the material on which a person 
works, but expresses, in the shape given to the material, the 
realization of purpose and will. While we can view work as 
expressing human intent, we must also recognize that the 
structure of human activity delimits the adaptability of the 
world we live in and the possibilities for altering cultural and 
social conditions. 

Work involves a developing interplay of activities, 
beliefs, norms, and social relations that is particularly 
important in institutionally defined situations. From an 
institution's structures emerge historically conditioned ways of 
expressing intent, establishing social relations, and giving 
form to the social world and one's own humanity. 

Because school work not only defines the possibilities of 
human creative activity but also provides opportunities for 
cultural development and social mobility, the institution's 
definitions of work are exceedingly important. The patterns 
of activities, social relations, and sentiments produced in 
schools must be clarified, so when the effects of reform are 
investigated we can question how reform technologies sustain, 
modify, or otherwise relate to these institutional patterns. 
The relationships between technologies of reform and other 
elements of institutional work should make the significance of 
intervention programs apparent. 

Professionalism as a Social Category 

Schools are staffed by an occupational group whose 
activities give legitimacy to patterns of work and conceptions 
of knowledge* Often that group uses the slogan "profes- 
sional" to establish its status, privilege, and control. 
Certain occupational groups-^professicns— at work in schools 
have the authority and power to define pedagogical practices. 
The label "professional" is used by occupational groups to 
signify a highly trained, competent, specialized, and 
dedicated group that is effectively and efficiently serving the 
public trust. But the label "professional" is more than 3 
declaration of public trust: it is a social category that 
imputes status and privilege to an occupational group. In 
teaching, the label signifies not only technical I'^nowiedge and 
service, but the power of a particular group to bestow social 
identity ("students") upon its clients. 
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Some have argued thdt the culture of professionalism may 
have consequences for the capacity of individuals to provide 
for themselves (Lasch, 1977). Individual ability and personal 
competence have been progressively diminished through 
schemes controlled, disseminated, and evaluated by particular 
occupational grours. To ^'educate" students for American 
life, school professionals have acquired mandates to teach 
children problem-solving, values clarification, sex education, 
health education, safety education, and much more. These 
subjects reflect a professional definition of what kind of 
"help" should be given to people growing up and entering 
society. Such education often poses a contradiction: while 
the purpose of schooling is the introduction of certain forms 
of social and personal autonomy, it also introduces a form of 
dependency; people learn to rely upon professionals to define 
and solve social problems. Psychologists give diagnoses and 
prescriptions for marital or family problems; urban sociol- 
ogists issue guidelines for living together in cities; and 
educators define what knowledge, reasoning, and thought Is 
taught to children in our society. 

THE RESILIENCE OF 
INSTITUTIONAL ARRANGEMENTS 

The complex social and political arrangements of work, 
knowledge, and professionalism are not easily altered, and 
when we examine the context into which educational reform is 
introduced the assumption that reforms will be faithfully 
implemented can be questioned. Faced with reform, insti- 
tutions exhibit remarkable resilience; innovations are first 
incorporated into existing patterns of behavior and belief, 
then used to legitimize ongoing patterns of educational con- 
duct, while being identified in slogans to suggest reform. In 
this study three patterns of schooling were found which we 
have labeled technical, constructive , and illusory » 

Making Schools Efficient: 
Technical Schooling 

Among the schools reported to have exemplary IGE pro- 
grams, three--Maplewood , Belair, and Clayburn — share 
common institutional characteristics. Although the 
communities they serve display considerable socioeconomic 
diversity, the schools are quite similar in the configurations 
of work, knowledge, and professionalism they offer in their 
implementation of Individually Guided Education. 
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Ceographicdlly , these schools are widely separated: 
Clayburn is in the southeast, Maplewood is in the midwest, 
and Belair in the west. Clayburn is essentially rural, 
Maplewood is suburban, and Belair is in an urban area. 
One-third of Clayburn's student population is black, but 
minorities have only miniscule representation in the other 
schools. Clayburn is also the only school that serves more 
than a local neighborhood; some of its black students are 
bused across the county to achieve racial balance. 

There are other differences among the three schools. 
Maplewood is solidly middle class, with few students from 
wealthy or poor families. On the other hand, nearly one-half 
of Clayburn's students qualify for federal educational assis- 
tance. Belair's students represent a range of family incomes, 
but of the schools we studied its neighborhood is the only 
one in which millionaires are reported to live. Information 
obtained from school personnel places Clayburn at the low end 
of the income scale and Belair at the top end, with Maplewood 
in the middle. It should be kept in mind, however, that 
Beldir pulls students from the widest economic range, from 
welfare recipients to reported millionaires. 

While there are demographic, as well as physical, dif- 
ferences among Belair, Clayburn, and Maplewood schools, we 
found theni to be alike in their understanding and implemen- 
tation of Individually Guided Education. In a survey de- 
signed to measure the extent to which ICE technology and 
principles are perceived as operational by a school staff (ICE 
Implementation Survey), teachers of all three schools saw 
themselves as impiementors of a school "Unit" organization 
characterized by a flexible separation of children into 
multiaged groups, team planning of the curriculum, and 
teaching activities appropriate to a range of student interests 
unci abilities. Teachers in these schools identified the 
Instructional Programming Model as a second key feature of 
ICE: they perceived themselves as formulating objectives for 
students, establishing record-keeping procedures to monitor 
achievement, and p oviding a set of instructional activities to 
guide stiidents of • iffering abilities toward the achievement of 
individual objectives. 

An important part of teaching in these ICE schools is to 
sequence the work students do so that teachers can manage 
pupil activities and monitor their achievements. These manage- 
ment procedures are often justified in reference to broader, 
mure abstract educational purposes, such as enhancing achieve- 
ment, learning better, or developing conceptual thought. At 
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Maplewood, Cluyburn, and Delair, however, management tech- 
niques have become the ends of school activity rather than a 
means of instruction, and technology provides an independent 
value system that gives definition to curriculum, classroom 
activity, and professional responsibility. While these three 
"technical" schools differ in some of the formal ways through 
which they organize instruction and in their physical 
arrangements, all three incorporate ICE technologies into 
everyday activities and make technique into a value. 

The effect of viewing technologies as the ends of school- 
ing was to alter the social relations by defining the content 
and the nature of the school work in such a way that individ- 
ual control over ideas or work was denied. As ICE was 
originally designed, the language of technology was planned 
as a tool, an aid to the teacher's and student's assessment of 
progress. The designers viewed the language of systems as 
coexisting with a language of ideas. In practice at the 
technical schools, this coexistence has never developed, and 
the language of procedu'"es has become legitimized as the 
substance of the curriculum itself. 

Professionals searched for the most efficient ways to 
process people. For example, a teacher at Belair spent a 
major part of his time planning improvements in record- 
keeping procedures for children's mathematics levels. The 
emphasis on processing people resulted in an unusual defini- 
tion of responsibility. For teachers, responsibility did not 
mean considering what was appropriate to teach and how to 
best teach it; rather, responsibility meant structuring ob- 
jectives, keeping proper records, and insuring an orderly 
movement of children. In these schools, the unit planning 
time and decision-making process of Individually Guided 
Education came to be used in a way that denigrated the 
knowledge and work associated with teaching. For children, 
responsibility meant learning and obeying the rules of the 
classroom, listening to authority, and striving to master 
predetermined objectives. Responsibility was operationally 
defined as accepting dependence upon others for ordering 
activities and thinking about intellectual problems, rather 
lhan taking charge of these issues in any manner. The 
criteria of teachers' and principals' success in all three 
schools seemed to be related to the degree of planned control 
that could be exercised over children's progress. 

"Excellence" was generally achieved by looking busy 
(process), or by producing in quantity (outcomes). These 
criteria often applied to both teachers and students. The 
definition of a better teacher in one school, for example, was 
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one who spent more time before and after class preparing 
lessons and keeping good records, and who kept children 
looking busy. For children the ability to look industrious 
was important, and achievement was often judged on the basis 
of hard and continuous work rather than on the quality of 
the results. 

In the technical schools, knowledge was standardized. 
All ideas and skills to be learned were presented in a discrete 
and sequenced form. Ordering knowledge in this way enabled 
teachers to devote full attention to the procedures of imple- 
mentation. The standardization of ideas was demanded by the 
process of social control. This standardization of knowledge 
reduced the curriculum to learning that could be measured. 
The teachers at the technical schools have interpreted in- 
dividualized education as a systematic way of responding to 
children's lack of specific information or skill. No curriculum 
or instruction is considered appropriate unless precise, 
measurable objectives are stated. Instruction can then follow 
the tcst-teach-test routine. 

The emphasis on preplanning and measurement eliminated 
from consideration the serendipitous, accidental, or proble- 
matic process of instruction. Many valuable learning exper- 
iences arise from children's Interactions with materials, 
people, and events. If a child enjoys the alliteration in a 
poem, a teacher can capitalize on that interest when planning 
future activities. Similarly, a lesson on figuring change may 
raise questions about currencies in other countries and how 
they differ from ours. Such opportunities for learning were 
observed in the technical schools' classrooms, but the 
emphasis or^ technical mastery limited classroom exchanges to 
short, utilitarian interactions serving immediate goals. 
Serendipitous learning was improbable in the technical schools. 

Breaking learning down into a sequence of objectives to 
be mastt.ed created a division between the conception and 
execution of work. Each element was defined for the learner 
in isolation, distinct from the logic which might guide or tie 
activities together. The consequence of this separation was 
that teachers and students lost control over their work. 

Nevertheless, data gathered at Maplewood, Belair, and 
Clayburn indicate that the daily routines and instructional 
practices of these schools do have a coherence, a coherence 
t)rovided by five educational slogans which teachers identify 
with their support of Individually Guided Education. The 
slogans are individualizotion, continuous progress, meeting 
r'.'Idrcn's needs, positive self-image , and accountability. 
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These words provkie the public language through which 
teachers and administrators discuss school conduct, justify 
program planning, and give coherence to the reform program 
itself. The words in effect hold the promise that the quaT^y 
of schooling will improve. They establish a mood with which 
both parents and professionals can feel comfortable and with 
which they can affiliate particular pedagogical practices. 
Teachers perceive that the social and cultural life of the 
community gives them a mandate to focus on basic skills and 
social discipline. Professional ideologies supply a technical 
definition of educational problems. Together, these influences 
give credibility and legitimacy to the programs in the tech- 
nical schools. 

Professional ideologies in school district administrations 
and in other educational agencies defined the task of school- 
ing in terms of management and efficiency and provided stil! 
another source of credibility and support for the technical 
schools. In school district administrations, the internal 
managemeni procedures and emphasis on efficiency in these 
schools were seen as an extension of district programs to 
develop consistency and standardization, Districtwide ob- 
jectives, criterion-referenced measures, a single reading 
textbook series, and curriculum management systems had all 
been introduced in at least one of the districts. The 
superintendent in another district viewed the development of 
a standardized and consistent program in cll district schools 
as essential to good school administration. At the district 
office of the county in which Clayburn is located, school 
management appeared to be important as well. The curricu- 
lum coo'^dinator said that the district was beginning to 
develop a comprehensive management scheme which would 
include many of the instructional procedures at Clayburn, and 
that management systems of inotruclion were being introduced 
districtwide through an adaptation of the reading textbook. 

Professional agencies outside the Clayburn school district 
also gave credibility to the school's program. The state 
department of instruction regularly used criterion-referenced 
tests to determine the level of achievement in schools through- 
out the state. In practice, this state policy gave legitimacy 
to instructional practices which aimed to improve test scores-- 
like those found at Clayburn. At Maplewood and Belair, 
standardizing curriculum and rationalizing instruction were 
also given credence by agencies outside of the schools. The 
superlntondent in Maplewood's district considered the school 
as a model for other schools to emulate, and Maplewood's 
principal and staff gave workshops and talks to other district 
personnel. The state education agency supported the school's 
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computerized record-keeping program. At Belair the principal 
received strong support from the superintendent's office, and 
also had bacl<ing~including a grant—from state officials. 

It must be pointed out, however, that the technical 
emphasis given to conceptions of knowledge and to work at 
Clayburn, Maplewood, and Belair obscured underlying social 
and political issues embedded in the process of schooling. By 
focusing attention on problems of management and of effi- 
ciency, the existing priorities, values, and patterns of social 
control remained unscruitinized. While the three schools re- 
sponded to and were sustained by institutional, demographic, 
and cultural facets of their communities, the emphasis on 
technology appeared to separate education from other com- , 
munity affairs. School staffs operated as though there was a 
broad consensus about the goals of instruction, and teachers 
appeared to believe that the school mandate was unambiguous. 
Far from be:ng a technical matter, however, the choices that 
have to be made in education involve substantive issues about 
social life and its interpreta*ion , and they require debate. 

The combination of social factors that makes technical 
school practices legitimate is a historical question which 
cannot be addressed here. It Is crucial, though, to consider 
our contention that the technical definition of the school 
mandate actually serves the interests of neither the community 
nor the teachers. The dissociation and fragmentation of 
knowledge and work in these schools produce a definition of 
professionalism that limits the creative and purposeful quality 
of teaching. Students are offered a mode of thought that 
cannot penetrate the complex patterns of communication dom- 
inant in conteiuporary society. Schooling is thus robbed of 
its imaginative ar.d liberating potential. The emphasis on only 
the most limited skill acquisition legitimates a style of work 
whicii is fragmentea. isolated, and unrelated to truly purpose- 
ful activity. This st/le of school work and reasoning, if 
intt rnalized, imposes occupational limitations upon the stu- 
dents: rather than offering options for adult life, this 
schooling legitimates the specific demands and expectations of 
the social and cultural majority of the community, it provides 
no means for considering new possibilities beyond those 
suggested by circumstances of birth and community location. 
It aiso helps to perpetuate a belief that success in late life is 
directly proportional to success in basic skills. 
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Exploring Ways of Knowing: 
Constructive Schooling 



Kennedy School Is located in a university town on the 
edge of the foothills of a major mountain range. For years 
the community remained modest in size, and the university 
and agriculture were the mainstays of the town. Recently, 
however, corporate industry has discovered the area and the 
population has expanded dramat'rally . Much of the new 
industry uses advanced technology. In addition to the lure 
of jobs, a pleasant climate and recreational opportunities make 
the setting attractive. On several occasions people in the 
school system commented to us that new families were moving 
into the community because of its attractiveness even though 
the parents had not yet found employment. The conventional 
wisdom is that population and business growth will continue 
unabated in the foreseeable future. One new school opened 
in 1979, and the school district has been hiring a substantial 
fiumber of new teachers. 

When wo first visited Kennedy Elementary School we had 
already spent considerable t*me in those schools we have 
characterized as technical, and our experience had led us not 
to expect any major variations in the way ICE was interpreted 
and implemented. It was with some surprise that we con- 
fronted a totally different set of institutional assumptions and 
bonaviors at Kennedy. The term constructive eventually 
emerged to summarize the patterns of work, conceptions of 
knowledge, and professional definitions that gave meaning and 
interpretation to this school situation. 

Constructive schooling, rather than emphasizing state of 
knowledge, pays attentior^ to the ways knowledge is created. 
In the curriculum, relational ideas and the exploration of 
cjeneral principles and concepts are stressed, and skills are 
developed within that context. For analytical purposes we 
cati separate the kind of work and knowledge that occupied 
students ^rom that which occupied teachers, but in actuality 
they are inseparable. 

Tfie commitment at Kennedy was to make the school "a 
kid's place," and this commitment i ested in part on the belief 
that different kinds of activities and experiences contribute to 
children's intellectual and social development. The resulting 
curriculum desicjn provided a broad range of ways of knowing 
und leurning. K ennedy students vere continually offered 
expcrionces tfujt included art, music, poetry, drama, logic, 
literature, science, history, and even controversial issues. 
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The variety of classroom work and knowledge at Kennedy 
shared three characteristics. First, the problematic aspects 
of knowledge were emphasized. Second, aesthetic forms of 
knowledge, in which poetry, drama, music, and art are used 
to produce and express understanding, were incorporated into 
school work. Third, frequent efforts were made to integrate 
different kinds of knowledge and skills. While from time to 
time we found examples of problematic, aesthetic, and inte- 
grative work at the other schools we studied, the persistence 
and pervasiveness of these characteristics was definitive of 
the curriculum at Kennedy, 

Within the set of beliefs, priorities, and patterns of 
conduct established at Kennedy, Individually Guided Edu- 
cation was given a special meaning. While teachers appeared 
to have adopted the main elements of the reform program, the 
technologies were used in ways that responded to the defini- 
tions and special requirements of the school. The organiza- 
tional structures of ICE, such as the Units, provided forums 
in which teachers could carry out their programs. Some form 
of the Instructional Programming Model was used In a few 
subject areas, but not to guide instruction. ICE's record- 
keeping procedures provided evidence that the school dis- 
trict's minimum objectives were being respected by the staff. 

The interest at Kennedy In promoting student Initiative 
dnd autonomy has its corollary In the work of teaching itself: 
teachers viewed themselves as having the responsibility to 
decide what knowledge was to be introduced into classrooms, 
how it was to be introduced, and when. The value placed on 
autonomy did, however, involve the constructive school 
teachers in a professional conflict with the district adminis- 
tration and its policy of "consistency" in the curriculum. 
This policy entailed the specification of common behavioral 
objectives that all teachers were to follow in developing the 
basic curriculum for the several grade levels and the require- 
m<>nt that all schools use the same reading program to ensure 
that students who transferred from one school to another 
experienced little discontinuity in reading. The Idea of a 
liicjhiy specified curriculum was offensive to the staff because 
they believed it was their right as professionals to make 
expert decisions about what educational experiences were 
appropriate for their students. 

Also important in understanding constructive schooling is 
the relationship of Kennedy school to its community. It is 
clear that the style of life and orientation of the community 
influenced specific patterns of instruction: parents supported 
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the instructionul emphasis on multiple foi.iis of knowledge and 
their children's active participation in learning; teachers often 
took the backgrounds of their students into account when 
planning programs; children related their own experiences to 
the programs and, in some instances, took the initiative in 
determining programs. 

The intellectual and social points of view found in the 
school are those of that substratum of the middle class repre- 
sented in the professional occupations. The emphasis on 
interpersonal control characteristic of this substratum en- 
courages facility with language and responsiveness to the 
subtle nijances of Interpersonal situations. These abilities, 
necessary to enter the professions, are reflected in the 
flexible roles and ideas found in Kennedy school: knowledge 
and work are the property of the individual and enable him 
or her to establish control in interpersonal relations and to 
maintain skepticism toward ideas. 

With knowledge and work defined as the property of the 
individual, the pedagogic emphasis is upon children's exhibit- 
ing the attitudes and emotions appropriate to learning. 
Participation and involvement are the criteria of performance 
and achievement, and children's activities are monitored to 
assess the underlying attitudes and emotions that give pur- 
pose to their intellectual and social activities. At Kennedy, 
all aspects of intellectual and social life were treated as part 
of the public concern of teaching. Reducing the private 
space in institutional settings like schools can make it harder 
for an individual to withdraw, even momentarily, and can 
make norms and expectations more coercive. In addition, the 
language of constructivism— abstract, complex in construction, 
and self-reflective--while it legitimates the skills and 
sensibilities of intellectuals, denigrates the creativity, 
imagination, and craftsmanship entailed in some physical 
work. 

The relationship of Individually Guided Education to the 
conditions of constructive schooling can be described as 
follows. The aspects of the ICE program used at Kennedy 
were those which sustained the knowledge, VNiOrk, and profes- 
sionalism of constructive schooling. The Unit and team- 
teaching technologies were employed as devices through which 
teachers could express school and classroom priorities, and as 
a response to outside pressure for consistency. The Instruc- 
tional Programming Model was an integral part of the program, 
but it existed as a symbol of change and effectiveness in the 
school. Its systems of record-keeping and testing were not 
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basic to teachers' thirikiruj and planning, Records were used 
to prove to others that skill development was given explicit 
attention. The priorities, beliefs, and norms of Kennedy 
demanded a flexibility and ambiguity of ideas and work that 
made those aspects of the Instructional Programming Model 
appear subsidiary and of minor importance. 

The concrete ways in which the interests and orienta- 
tions of the community and school district were mediated in 
Kennedy School is one of the major concerns that emerges in 
our analysis. While in the technical schools it was evident 
that the relationship of pedagogy to external factors was 
significant, the relationship was suppressed, to some extent, 
by the emphasis on the procedural aspects of school life, 
The language and procedures of technical schooling made 
pedagogical activities seem efficient, objective, and neutral in 
application. In Kennedy what we see is the confluence of 
contradictory forces which attempt to define and shape the 
school. The definition of schooling advocated by the central 
adrninistrdtion and the technologies of ICE were adapted In 
relation to the expectaiions and demands posited by the 
specific community in which Kennedy is located. 

Form as Substance: 
Illusory Schooling 

In analyzing the institutional meanings of Charles Evans 
and Pierce elementary schools, we discovered a series of 
anomalies, discontinuities, and contradictions. Much of the 
action of these schools created an image of rational, con- 
trolled, and productive enterprise, and their practices 
appeared to be governed by a wish to create a positive 
image: what professionals and parents want and hope for is 
actually happening. While in a few instances the image 
represerUed reality and could be substantiated by observa- 
tion, in many other instances the image was void. 

Work and social interaction at Charles Evans and Pierce 
presented fundamental contradictions. There were facts and 
subjects to be taught, but the rituals and ceremonies of the 
formal curriculum were unrelated to this content and therefore 
could not produce success for most pupils. The social pro- 
cesses of the daily activities, however, did have substantive 
meaning. Teachers perceived the failure to learn as a result 
of conditions in the children's lives (broken homes, indif- 
ference to academic values, lack of educational readiness) 
which were believed to make achievement impossible for all 
but a lucky few. The shortcomings of the schools were 
attributed to the inadequacies of the poor and minority com- 
munities in which the schools were situated. 
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The label illusory applies to both tfie images and the 
details of life in these schools--the false impressions created 
by the everyday patterns of activity, and the substantive 
values represented by these patterns of schooling. The 
emphasis on community pathology, pedagogy as therapy, and 
ritual gives these schools meaning different from those of the 
technical and constructive schools. 

How then, did teachers in the Pierce and Charles Evans 
schools see the problem of teaching? What conceptions of 
knowledge and of learners did they bring to the practices of 
schooling? How did they define the mandate of schooling? In 
the technical schools the prevailing belief seemed to be that 
teaching involves uncovering student deficiencies in skills and 
implementing an instructional system to correct those defi- 
ciencies; the language of Individualization, children's needs, 
and continuous progress expressed these beliefs. In the 
illusory schools, teachers were pessimistic, not sure they 
could overcome children's learning deficiencies; no technical 
or professional skill could make up for such "social defects" 
as uncaring homes and cultural indifference to academic 
values. The ideology of professional practice that emerges In 
the illusory schools is one of social pathology — a belief in the 
cultural inadequacy of the children who attend these schools. 
The knowledge and work transmitted in these schools is 
related to this view of social pathology. 

Professionals in both Pierce and Charles Evans schools 
made frequent references to the unstable and unsupportive 
home lives of their pupils. Both schools are situated in 
communities regarded as "difficult" by their staffs: Pierce 
enrolls mainly pupils from white, low-income families, a 
number of whom receive welfare assistance; Charles Evans 
enrolls children of low-income black families whose economic 
position is even less secure. With a ''sw exceptions, teachers 
in the two schools generally believed that achievement at a 
"normal" rate was possible for only a few of their students. 
To teachers and principals alike, these communities were 
characterized by poverty, broken homes, and an underclass 
culture that is indifferent or hostile to academic values and 
that creates social conditions that prevent pupils from learn- 
ing. Whether or not these perceived conditions are realities, 
the professionals in the schools believe they are. 

[ly accepting the idea that community conditions can 
influence schooling, teachers also affirm the view that those 
outside conditions can hinder children's work in school. As a 
result, there is an emphasis on professional competence in the 
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face of what seem to be overwhelming odds. The possibility 
of success exists only If children In school can overcome the 
debilitating elements of their home lives. On the other hand, 
when students fai! to achieve, their failure can be attributed 
to community pathology or a lack of individual motivation. 
Student failure is not seen as the result of the structural 
qualities and norms of schooling Itself, 

A glance at the dally activities of Charles Evans and 
Pierce schools reveals what on would expect to find In any 
American school: there are established times for teaching 
language arts, social studies, reading, and mathematics, and 
children go to the gymnasium for physical education and have 
art and music classes. The curriculum at the two schools is 
given a particular nonconventional form through the tech- 
nologies of Individually Guided Education, Units, small 
groups of children, and tall< of instructional planning pervade 
the patterns of school conduct. 

Lool<lng more closely at the actions and behaviors in the 
schools, discrepancies and discontinuities emerge. Rather 
than engaging in any elaborate grouping or testing practices 
to determine instructional needs, instruction follows the 
sequences outlined in whatever teachers' manuals or textbooks 
are being used. As one probes further, this textbook Instruc- 
tion takes on a ceremonious quality. 

The discrepancies and discontinuities between the form 
and the substance of schooling in Charles Evans and Pierce 
schools appear in the response of these schools to the ICE 
reform program. In both schools, reform Is symbolized in a 
language that refers to "flexibility," "individualization," 
"grouping and regrouping," and "testing," and bulletin 
boards at their entrances announce that these are ICE 
schools. Yet when we tried to observe the regrouping of 
children, the implementation of a "systems" approach to 
curriculum, or the use of evaluation procedures, we were 
unable to find clear evidence that these schools were doing 
what they said they were doing, 

AltfiGugh optimism about the school mandate pervaded 
technical and constructive schooling, the staffs at the illuiory 
schools were pessimistic about conventional goals of instruc- 
tion. The day-to-day activities in the illusory schools gave 
priority to teaching what was considered the necessary be- 
haviors, self-control, and attitudes, rather than formal 
schoolwork. It was the social messages in the instructional 
processes that gave definition to the concept of work and 
knowledge. 
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The emphtisib in the Illusory schools on rules to be 
obeyed should be considered more closely. To establish a 
rule is also to express a tacit message about what values 
should underlie the structure of control. The rules of 
illusory schooling are not what we might associate with the 
conventional "management skills" or discipline children should 
learn in order to master formal schoolwork. In the technical 
and constructive schools, teachers expected everyone to know 
how to act to accomplish their work, even though they might 
need reminders. In the illusory schools, teachers believed 
that children did not know how to act and that the first task 
of schooling was to establish the behavior necessary for 
schooling. The social process of instruction in the illusory 
schools emphasized values related to the children's character 
formation, such as cooperation, hard work, respect for 
property, and the delay of gratification. Teachers perceive 
these behavioral and attitudinal characteristics as lacking in 
the children's home environment. At Pierce school, teachers 
and a guidance counselor developed a motivation program to 
help children learn to get along with each other. 

A distinction, then, exists between curriculum as the 
formal subject matter of schooling and the "curriculum" of 
social processes at Pierce and Charles Evans schools. The 
formal curriculum at these schools is a ritual involving little 
follow-through or substantive work. The social processes of 
instruction, however, do yield values and meaning: the 
acquiescence to external authority, respect for property, 
delc-jyed gratification, and hard work required of a moral 
person are emphasized. Often the image of the school as an 
institution conveying moral values is juxtaposed to the com- 
munity and the children's homes to indicate the benevolence 
of institutional arrangements and the inadequacies of the home 
environment. 

Like the actions and behaviors within these schools, 
their relations to parents and school districts were also subtle 
cind contradictory. While our data collection procedures 
focused upon the schools and limited our researchers' involve- 
niont with external agencies, certain district and state policies 
druj proctices emerged and were identified as factors that 
influenced and legitimated the illusory quality of schooling. 
Many activities undertaken by the school staffs were viewed 
as public relations efforts in response to pressures for 
ch.nuje dnci increased efficiency; their purpose was ;o con- 
vince parents that tlie schooling was efficient and benevolent. 
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The home-school-community relations component of the 
ICE model is intended to increase parent participation in and 
understanding of the school's program, in the illusory 
schools, however, home^school-community activities had a 
more specific meaning: parents' interactions with profes- 
sionals functioned both to legitimate school practices and to 
separate professionals in the school from parents in the 
community. 

In brief, the policies and practices of the schools, school 
districts, and states appear to accept criteria of program 
development and evaluation that legitimate the conditions of 
schooling found in Pierce and Charles Evans. Procedural 
questions and surface characteristics are used to project 
institutional competence and benevolence. Public relations 
efforts serve to establish the superiority of school morality 
and behavior. While the evidence suggests that practices and 
policies external to the schools act to legitimate illusory 
schooling, we realize that these relationships need to be 
treated more systematically than our data permit. 

The role of public relations in school legitimacy was 
illustrated by the ceremonial uses of ICE at Pierce and 
Charles Evans. Professionals viewed the technologies of ICE 
as part of the way the schools expressed their relations to 
their communities. District administrators and school 
principals talked about the pressures placed on the school by 
the public--pressure to improve reading and mathematics 
achievement scores and to create rational, efficient 
organizations. In response to these demands, ICE technol- 
ogies provided parents with information such as objectives 
and test scores that enabled them to feel that they knew what 
was going on in the schools. 

The illusory schools are confronted with a social predica- 
ment which the staffs do not perceive to be of their own 
making. The conventional mental ioirning of skills and 
knowledge is thought to be unattain^jble for most students. 
Children are seen as deficient because of the debilitating 
tfffects of home life and community. Teachers view the 
children who como to the schools as poorly equipped with the 
sensibilities, manners, and awarenesses appropriate for learn- 
ing. Patterns of school work are concerned with learning 
how to act; the operative conceptions of school work and 
knowlecicje emphasize the development of obedience and acquies- 
cence to institutionalized social authority, and acceptance of 
certain aspects of middle class culture. 
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The nature of illusory schooling is illuminated through 
its discrepancies and contradictions. The organization of 
instruction and the routines of school work and teaching are 
often without content. The language of "meeting children's 
needs," of individualization, and of grouping is circular, and 
it becomes questionable when referred to concrete actions. 
The routines and language forms at Pierce and Charles Evans 
schools, however, help to project an image of schooling as 
rational, productive, and competent. 

In all the schools there are discrepancies between what 
the schools hope to do, what they think they are doing, and 
what they actually do. The type and extent of these discrep- 
ancies at Pierce and Charles Evans lead us to distinguish 
between technical and constructive schooling, on the one 
hand, and illusory schooling on the other. In technical and 
constructive schooling, the formal categories of the subject 
matter play a significant role in the organization of school 
work and knowledge. The Integration of content and personal- 
ization of knowledge give a particular meaning to constructive 
schooling. The fragmentary and hierarchical organization of " 
knowledge, together with precisely specified forms and types 
of work, provide meaning for technical schooling. In illusory 
schooling, in contrast, the subject-matter objectives that 
children recite, the emphasis in teachers' conversations, and 
the norms of classroom discourse create a definition of knowl- 
edge and work only tangentially related to any formal curric- 
ulum. The messages of the instructional processes in Illusory 
schooling contain different meanings. They give reference to 
community pathology and docile student behavior. The formal 
curriculum content in these schools seemed secondary to the 
inst tutional purpose of developing a controlled and morally 
correct student population. Yet, one must view the ritual of 
participating in school work as having possible substantive 
values. The rituals define the formal categories of school 
knowledge as important in society and for individual success 
and achievement. The lack of follow-through in teaching the 
content and skills of the subject matter produces failure 
which is to be viewed as personal. It is defined as personal 
by the ceremonies which make it seem that all are being 
taught in a competent institutional setting. 



CONCLUSION 

The aim of Individually Guided Education is to provide a 
set of organizational and curricular procedures that if fol- 
lowed could be used in any community or social context. ICE 
assumes psychological differences among students; the central 
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technologies of the reform program circumscribe the variety of 
responses that these psychological differences require of 
teachers. Underlying the reforrr technologies and the empha- 
sis on individua' variation are the assumptions that the reform 
will make schooling meritocratic, and that each student will 
progress according to his or her ability regardless of the 
social conditions from which the child comes. The belief that 
schooling can be a rational, efficient, and objective response 
to individual differences is not unique to ICE; it is drawn 
from broader educational thought about school accountability, 
curriculum as management, and systems perspectives on 
school organization (Kliebard, 1979). The unique quality of 
the ICE reform program is that it offers a comprehensive 
organizational, political, and curricular system that appears to 
respond to demands for a true meritocracy. 

We find, however, that Individually Guided Education 
neither creates a universal condition of schooling nor frees 
schooling from the constraints of different social conditions. 
Our data uncover configurations of schooling that respond as 
much to community and professional interests as they do to 
students' differing capabilities. In each of the three kinds of 
schooling we have identified, the use of ICE technologies is 
shaped by distinct assumptions about teaching, learning, and 
schooling. The ways in which a school reform effort is 
shaped by different social contexts and predicaments is the 
focus of this final section. 

The influence of professional ideology on the meaning of 
the daily activities of schooling is apparent when we compare 
technical, constructive, and illusory schooling. Despite the 
fact that ICE implementation literature includes extensive 
descriptions of the program's goals and technologies, teachers 
and pupils in the six schools translated the slogan "Individ- 
ualization" in a way that responded to certain beliefs they 
already held about children and learning. In the technical 
schools, children were considered deficient with respect to a 
body of predefined knowledge and skills. The underlying 
psychology of learning was behavioristic , and knowledge was 
held to exist outside the minds of individuals. Individual- 
ization, in technical schooling, was a matter of pacing chil- 
dren tf^rough specific levels of information and skills. In the 
constructive school, knowledge was considered to be personal; 
individualization involved the child in a communicative process 
that would enable him or her to exercise control in inter- 
personal situations. In the illusory schools, since the chil- 
dren's backgrounds were seen as pathological, the individual- 
ized instruction was therapeutic: appropriate social values 
and behaviors could be sought and acquired, together with 
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those minimal aciidemic: skills that students were able to 
acquire, given tUe social constraints under which they were 
thought to live. 

Those different professional ideologies defined the appro- 
priate means by which children were to engage in social 
relations, comprehend the world, and improve their social and 
cultural conditions. The technical schools' emphasis on 
procedures and efficiency, for example, standardized knowl- 
edge and separated the conception of work from its execution; 
this in turn produced fragmented and oversimplified tasks 
that removed from the activities of schooling the possibility of 
creating a self-organized, self-motivated, and self-renewing 
community. In contrast, the emphasis in the constructive 
school on developing facility with language and responsiveness 
to the subtle variations of social situations offered practice in 
controlling interpersonal relations. This emphasis in communi- 
cation skills, however, devalued knowledge related to certain 
kinds of physical labor. And finally, the ideology of pathol- 
ogy which permeated illusory schooling promoted the establish- 
ment of a moral basis for the socialization of children, in 
which schooling assumed a missionary quality. 

As significant as the differences between professional 
ideologies might be, a second important factor in definition of 
schooling was the relationship between ideology and the 
professionals' perception of the immediate community served 
by the school. In each of the schools studied, professional 
ideology was related, in part, to a definition of the kind of 
student being taught, and each of the three forms of school- 
ing offered different perceptions of students. The sense of 
what professionals could (and should) accomplish was shaped 
both by abstract beliefs about children and schooling and by 
a set of obligations and limitations arising from the profes- 
sionals' perceptions of their clientele. Professional definitions 
and descriptions of student populations entailed claims about 
the children's "needs," and meeting these "needs" was said to 
be the overall obligation of the school. However, the social 
characteristics of the children's community were treated by 
teachers as psychological traits inherent in the individuals 
that constrained the possibilities of schooling. 

That professionals perceive students as carrying differ- 
ent social characteristics is probably inevitable and not 
necessarily undesirable. Differences do exist among stu- 
dents, and certainly some differences are a result of the fact 
that children spend a substantial part of their time among 
people and in settings outside the school. Relations with 
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families and friends and activities in tlie neigliborliood can be 
thought of as sources of educational experiences; however, 
these experiences may or may not enhance the characteristics 
of the "good pupil" envisioned by the professionals. The 
problem with the vision, however, is that a school staff 
defines its mandate in relation to that ideal, often ignoring 
the actual linguistic competencies, cognition, and reasoning 
patterns of the children who come to the school. 

Those who would introduce educational reform measures, 
then, must recognize that their intentions, goals, and tech- 
nologies are profoundly subject to the specific dynamics 
affecting a particular institution. Reformers should expect 
that their programs will be interpreted, modified, and used in 
accordance with the professional ideologies which are asserted 
through institutions, as well as in response to conditions 
outside of institutions. The relationships among professional 
ideologies, communities, and classrooms are neither simple nor 
direct. They are mediated by signals nnd pressures exerted 
by parents, communities, and occupational groups outside the 
school, as well as by the interactions within the school. 

In considering the different pressures that interact to 
produce particular kinds of schooling, we must also recognize 
that schooling gives form to certain social and community 
interests, and that it is not at all a neutral endeavor. The 
six schools in this study are distinguished by different styles 
of thought and action tliat are passed on to the children as 
ways of maintaining relationship with the world; each of the 
institutional conditions identified offered different visions of 
society, rules for individuals establishing relationships with 
the social world, and principles of legitimacy by which to 
judge the adequacy of th' ^>e social relations. 

The relationships that we have found among social, 
cultural, occupational, and pedagogical practices suggest that 
the problem of reform in institutional life needs to be recast. 
The R — — model of change has a center-to^periphery 
orimtijlion; centralized groups were to develop the knowledge 
dnd proyri^ms necessary for school reform, and to disseminate 
n<)to the programs to the nation's schools. The flaw in this 
model of change becomes apparent when the logic of .ndividual 
differences and individualization is examined. Individual 
variation is a psychological abstraction which isolates human 
tr<iits, a[)titudes, and attitudes from the school setting, 
cultural environment, and social circumstances in which 
cfitldren function. It assumes, incorrectly, that individual 
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differences exist riprirt trom the social setting of schooling 
and that they can be "treated" in a logical and administrative 
fashion. 

What must be accomplished is the extension of the con- 
cept of schooling as an institution to articulate more clearly 
the social and cultural meanings that impinge on school li^e. 
These relationships are best formulated as questions: What 
conceptions of knowledge and work exist in pedagogical 
contexts? How do occupational ideologies and practice in- 
fluence the pedagogical context? What are the relationships 
among teaching/learning, occupational structures, and the 
social/cultural orientations of the communities in which the 
schools are located? 

The IGE study has pointed to the importance of under- 
standing how the^e sets of relationships affect institutional 
life and what meaning they give to reform. Their specific 
content and dynamics contain unresoh/ed questions and issues. 
For exuniple, how do specific social/cultural characteristics 
filter into the school to influence instructional practices, and 
what are the implications of teachers' different and potentiaily 
conflicting perceptions of their occupationai role? Profes- 
sionals do have relative autonomy in establishing pedagogicai 
practices, but how is this autonomy exercised to create, 
sustain, and renew occupational ideologies? What are the 
roles played by state and local education agencies, teachers' 
associations and unions, and teacher-preparation institutions 
in establishing and legitimating school practices? 

The interplay of these sets of relationships requires 
methods of Inquiry that respond to the complexities of the 
problem. The issue, however, is not one of qualitative 
versus quantitative neasures, or process versus output 
measures. Questionnaire and field study techniques need to 
be incorporated into research designs to provide descriptions 
of ongoing activities, the meaning that such actions have for 
those involved, the interpretations people give to their own 
actions and the actions of others, and the regularities and 
I urrelations exhibited in school practice. 

The history of social and political reform efforts sug- 
gests that their effects cannot be uncritically accepted and 
that- -no matter how benevolent the intent of the reformers — 
ufjforoseen, unplannea, and unwilled consequences must be 
cotuji(l(!ro(l ir^ ways that permit the researcher to go beyond 
tlie a^^sumptlons and priorities of those who administratively 
define the "system." Our research suggests that the distinc- 
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lion between inlt^nt and effficl is important in studying school- 
ing and reform efforts. While the intent of reform may be 
noble and sincere, planned social intervention is fraught with 
unanticipated and somttimes undesired consequences. The 
curriculum reform movement upon which ICE is based was 
built upon certain assumptions about educational change and 
reform, and our research has raised questions about both the 
refdrm and its underlying assumptions. The study of six 
elementary schools reported to be ;emplary of ICE Illustrates 
the complexity of making schools b ter. Schools are social 
and political enterprises characterized by interests that 
cannot be taken for granted. 
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CHAPTER 8 



Phase IV: THE FIVE 
CURRICQLUM STUDIES 

Thomas A. Romberg, Deborah M. Stewart, 
NoTTnan L Webb and Anne G, Nerenz 

The intent of Phase IV was to describe In detail the 
actual operations of a sample of schools using thr^e curric- 
ulum programs designed to be compatible with ICE: Pre- 
Reading Skills program (PRS) (Venezky & Pittelman, 1977), 
Wisconsin Design for Reading Skill Development (WDRSD) 
(Otto, 1977), and Developing Mathematical Processes (DMP) 
(Romberg, 1977). First, three small sample descriptive 
studies were conducted In ICE schools in Spring 1978, one for 
each program. And then, data were gathered for two compara- 
tive studies during the 1978-1979 school year. In the later 
studies three groups of variables— pupil outcomes. Instruc- 
tional time, and means of instruction— were investigated in 
ICE and non-ICE settings in which WDRSD or DMP as well as 
alternative curriculum materials were being used« 

In all studies, pupil attainment of program objectives was 
the dependent variable. The other two variables, instruc- 
tional time and means of instruction, are essential in ex- 
plaining and understanding how the programs work and how 
objectives a>^e obtained. The structural relationships among 
these variables are illustrated in Figure 8-1. The primary 
purposes of Phase IV were: 

1. to determine the degree to which PRS, WDRSD, and 
UMP meet their goal of having students mpster specified 
objectives and skills. 

2. to determine how time is allocated for instruction in 
implementing PRS, WDRSD, and DMP. 

3. to relate instructional time to the means of instruc- 
tion and mastery of content for PkS, WDRSD, and DMP. 

4. for WDRSD and DMP, to contrast ICE schools using 
the program with two situations — non-ICE schools using the 
program and ICE schools using alternative programs— on the 
variables of pupil outcomes, instructional time, and means of 
instruction. 
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Figure 8-1, Phase IV model of anticipated relationships between variables. 



CURRICULUM DESCRIPTION 



Pre-Reading Skills 



PRS was developed for use in kindergartens "to prevent 
reading failure by teaching children skills that are necessary 
for success In beginning reading" (Venczky, Pittelman, 
Kamm, & Leslie, 1974, Teacher's Guide Folder 1). Five 
ski'^s, three visual and two sound, comprise the program. 
Letter order (distinguishing no from on), letter orientation 
(distinguishing b from d) , and word detail (distinguishing 
take from tale) are the three visual skills. Sound matching 
(recognizing the same sound at the beginning of cow and 
kitel and sound blending (making pat from the sounds /ol , 
la/, and /t/) arc the two sound skills. 

The PRS program includes a variety of lar^e gro ep 
activities, small group games, and individual projects and 
practice sheets. This variety may be used to provide chil- 
dren with a range of learning experiences for each skill. 

In the preferred schedule, PRS instruction is provided 
every day, alternating between sound and visual skills. The 
recommended alternative is PRS instruction 3 days a week 
with a «^ound and visual lesson each day. After the visuai 
schedule has been completed, it is recommended that instruc- 
tion in sound skills be provided 5 days a week. Checkpoints 
are provided in both the visual and sound schedules. These 
points indicate when to give the individually administered 
skills tests and provide directions for teachers who decide lo 
form more than one skill group. 



WDRSD is an objective-based management system de- 
signed to provide both struction and substance fr r an ele- 
mentary school reading program. The focus is on developing 
the essential subskills of reading which, once acquired and 
.ippliod, oruible students to read successfully. The WDRSD 
ihjs four fundamental purposes: 

1. to identify and describe instructional 
objectives for the skills which appear essential for 
cornfietence in reading . 

2. to cissess individual pupils' skiil develop- 
ment status. 
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3. to manage instruction of children with 
different skill development needs. 

4. to monitor each pupil's progress. (Otto & 
Askov, 1973) 

The WDRSD provides a framework for teaching reading skills 
as the basis of a curriculum in which individual differences in 
students' rate and type of learning are emphasized. 

Six areas of reading skills have been Identified: Word 
Attack, Study Skills, Comprehension, Self-Directed Reading, 
Interpretive Reading, and Creative Reading. Behavioral 
objectiv- > were written for each skill in the first three of 
these six areas. The <;kills in the other three areas are not 
behaviorally described and assessment exercises are not 
included. Skills in each of the six elements are clustered at 
levels that correspond to traditional grjjde levels, as shown in 
Table 8-1, in order to facilitate initial implementation and to 
help in general skills assessment and regrouping. 

Formal tests of demonstrated reliability which are 
suitable for individual or groujj administration and which aid 
in the preparation of skill development profiles have been 
developed for most of the skills In Word Attack, Comprehen- 
sion, and Study Skills. The Teacher's Resource File includes 
a folder for each skill with a list of published instructional 
activities and at least a few new activities; teachers are 
encouraged to add to the folder other activities they have 
found particularly successful. 



Table 8-1 

WDRSD Skills by Element and by Traditional Grade Level 



Grade 



Skill area 




1 


2 


3 






4 


5 




6 


Wurd attack 


A 


B 


C 


D 














Conprohunsion 


A 


B 


c 


D 






E 


F 




G 


Study skills 


A 


B 


c 


D 






E 


F 




G 


S<-1 l-directcd reading 




A-C 






D- 


■E 






F-G 




Iiiti»ri>rct i V ruad lii^ 




A-C 






D- 


-E 






F-G 




Crt'at ivt? reading 




A-C 






D- 


-E 






F-G 
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Developing Mathematical Processes 



DMP (Romberg, Harvey, Moser, S Montgomery, 1974, 
1975, 1976) is a total program of elementary mathematics for 
grades K-6. It is composed of 90 topics which correspond 
approximately to grade levels as follows: 

Topics 1-14 Grade K 



15-27 Grade 1 

28-40 Grade 2 

41-53 Grade 3 

54-65 Grade 4 

66-77 Grade 5 

78-90 Grade 6 



The components of DMP are resource manuals, teacher's 
guides for each topic, student booklets and guides, printed 
and physical materials kits, a preassessment package, topic 
inventories, and pupil performance records, 

DMP approaches mathematics through the measurement of 
attributes. The major content areas are problem solving, 
place value, attributes, measurement, addition and subtrac- 
tion, multiplication and division, fractions, geometry, and 
statistics. An emphasis is placed on exploring rela .ships 
between objects using processes such as describing, classify- 
ing, ordering, equalizing, joining, separating, grouping, and 
partitioning. 

For each topic a sequence of activities is specified. 
Alternate activities are included for students who need more 
work on an objective or variation in instruction. The activ- 
ities are keyed to objectives. The topic inventories are used 
to assess mastery of the objectives for each topic. Instruc- 
tional activities include experiments, use of manipulatives ,* 
learning stations, games, stories, discussions, worksheets, 
and congests. 



DATA COLLECTION PROCEDURES 
Classroom Observations 



The data gathered from observations of teachers and 
pupils was based on a system modeled after the one used in 
the Beginning Teacher Evaluation Study (Marliave, Fisher, 
rUby, & Dishaw, 1977). The observation system (Webb, 
1979) used time as a metric to describe how the curriculum 




ERIC 



program operiites to facilitate students' achievement of pro- 
gram objectives. The behaviors of target students were 
recorded using time sampling procedures throughout the 
period allocated for reading or mathematics Instruction, 

The categor ies used in the observation system were: 

Available Time: allocated time devoted to the observed 
curriculum 

Nonapplied Time: allocated time devoted to other th?n 
the curricular program being ob- 
served 



Specific Content: 
Pace: 

Grouping: 

Materials: 

Learner Moves: 
Interaction : 



reading or mathematics skill (specific 
curriculum c^»jectives) 

whether the student is working at his 
or her own pace or is paced by the 
group 

size of group whiv-l* the student is a 
member 

the materials being used by the 
student 

student engagement or nonengagement 

persons with whom the student is 
interacting and the direction and 
focus of that interaction 



DBacher Logs 

Teachers maintair.ed logs for a sample of tarycw students 
in order to obtain a measure of the total time allocated to 
instruction on specific skills or objectives during the 
investigative period. On the iogs, teachers recorded the 
amount -^f lime allocated to instruction on each skill, the size 
of the group with which the target student was working 
during instruction, nnd the type of materials being used. 
Logs were kept daily for six to eight students by the teacher 
who was directly responsible for the instruction of the 
students in the target population. 




Interviews 



In each school interviews were conducted by the 
observer for that school with members of the participating 
instructioi.ul staff and with the principal. Background 
information about the school, the staff, and use of the 
curriculum products was obtained from these interviews. 
Instructional staff provided information about their own 
teaching experience, how the curriculum product was used, 
and how the overall instructional program was planned and 
carried out. Each principal d^ icribed the school's organi- 
zation, its relationship to ot' - • educational agencies, and 
some procedural aspects of the school's ongoing operation. 
From the interview responses the school variables identified in 
Figure 8-1 were scaled. 

Achievement Measures 

In the PRS study, group-administered tests developed 
by the PRS staff for each of the five PRS skill areas were 
used to measure achievement. The tests are criterion- 
referenced, and results provide teachers with diagnostic 
infornidtion. 

For the WDRSD and DMP studies, four forms of achieve- 
ment r nitoring tests were developed for each grade. During 
each testing, one-fourth of the pupils were given each form 
so that each pupil was tested on only a portion of the entire 
set of skills at a time. The forms were systematically rotated 
among the groups of students for each test time. A group 
score, percent correct, was computed for each objective using 
the corresponding items from all forms. In this manner, data 
were obtr.ined for the group on a large number of skills with 
minimal disruption of normal classroom activities. The WDRSD 
ochievement monitoring tests used items from the published 
WDRSD skills tests. For the DMP achievement monitoring 
tests, four items for each objective were written to corres- 
pond to the items included in the topic inventories for each 
objective. 



THE THREE DESCRIPTIVE STUDIES 

These small sample studies were designed to describe 
how ocich curriculum program was being used in different ICE 
schoulb ru.d, for WDRSD and DMP, to provide a testing ground 
for instruments and procedures for the comparative studies 
which were to follow. A comprehensive summary for the PKS 
study cari be found in Stewart, Ncrenz, Webb, and Romberg 
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( 1980); for V;UkSD in Nuren/, Webb, Romberg, dnd Stewart 
(1980); and for DMP in Webb, Nerenz, Romberg, and Stewart 
(1980). All three studies were conducted during the spring 
semester 1978. Three schools participated in the PRS study 
and two in each of the WDRSD and DMP descriptive studies, 
in the later two, data were gathered at both grades 2 and 5. 

Results— PRS 

Meeting program objectives, by the beginning of the 
study in February, the average scores on visual skills at all 
three schools were above the PRS program's recommended 
mastery level. This high level of student achievement in- 
dicates that the children were indeed acquiring the skills. 
Both kindergarten and first-grade teachers mentioned that 
children's visual scores had gone up, that the time needed 
for reading readiness had decreased, ano that children were 
more comfortable with reading skills. First-grade teachers 
reported that many reading skills could be reviewed rather 
than taught and emphasis could be put on blending rather 
than on the more elementary material. 

Time allocation. The developers of hKS recommend that 
instruction alternate between visual and sound skills until 
visual skills have been completed, that separate skill groups 
be formed if possible, and that review activities be provided 
only for students who have not demonstrated mastery of a 
skill on an individually administered test. 

At the beginning of the study, teachers reported having 
passed Checkpoint 4 in the visual schedule, after which time 
instruction in visual skills should have been provided only to 
nonmastors of the skill. Variation in visual skills instruction 
across schools was evident. 

None of the teachers in this study reported forming 
separate skill groups. In each of the interviews, all students 
were said to be on the same page in the schedule. 

!^elatif)g instructional time and achievement . An increase 
in the number of studerUs mastering sound blinding occurred 
in two schools where engaged time for that skill was much 
higher than at the other school. 

Where tinie was allocated to all skills for four or more 
children, test results generally indicated that the instruction 
led to increased average scores, or raised the minimum score, 
or both. 




Statf responses to Ihv program. Teachers at the three 
schools in this study were very enthusiastic about the pro- 
gram, enjoyed teaching PRS, and believed that the children, 
parents, and first-grade teachers had all responded favorably 
to the implementation of the program. The daily activities, 
tfie accessibility and attractiveness of materials, the thorough 
coverage of skills, and the quality of the materials for par- 
ents were listed as the major attractions of the program. 
Drawbacks were listed as not using letter names, not intro- 
ducing more letters, lack of supplementary visual materials, 
and amount of time needed for individual assessment. 

Overall, the data indicated that the objective of PRS of 
having children master specific skills was met. Pupils learned 
and teachers were enthusiastic about the program. There 
was variability among classes in how the program was used. 

Results— WDRSD 

Dnta were grouped for analysis at three progressively 
more general content levels. The most inclusive is the con- 
tent area, followed by the general objective, and then specific 
objective. In tftis chapter only results at the general objec- 
tive level of aggregation are discussed. I here are 12 such 
general objectives at eacfi grade level. Means of instruction, 
use of time, and achievement profiles are described separately 
by grade level. 

Grade 2. Even though the time allocated to reading 
'ikills was about the same at the two schools, students at one 
school received somewhat more skill instruction each day 
because the amount of available time was greater at the 
school. At both schools large group, other-paced settings 
were tho predominant mode of instruction. Instruction at 
botli bchoolb wci?> characterized by the use of paper and pencil 
materials about fialf of the time; at neitfier school was a 
variety of materials represented either on an individual day 
or across observation aays. Interactions were observed about 
t)rje-thrid of the time at both schools, usually teacher-initiated 
spiiOfh. Tfuis, the f)ercenta9e of allocated and available time 
•irui Jhe jvor.ujt^ rujrnber of minutes for four means of instruc- 
tum variables were ainost identical. 

The use of time during reading skills instruction appears 
to he very Similar at the two schools. Each school provided 
mstruitiiin nn dhout 80'' of the possible instructional days. 
Ovff <\\\ oi the .4>servation days, 62^ of the time was actually 
available lor instruction. Of this, engagement average 68*^ at 
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one school, and 70'^ iit the other. Most of the observed and 
allocated time was devoted to Word Attack skills. 

At grade 2 the achievement monitoring tests covered 10 
of the 12 general objectives. Students at both schools had 
mastered phonic analysis-consonants at test time 1, and at 
school 4 initial achievement in passage meaning was also high. 
By test time 3, students had mastered one additional skill, 
although this differed by school. At neither school, then, 
was a mastery level of 80% or more correct achieved for a 
majority of the general objectives for which data were 
obtained. 

Variations in initial achievement and type of progress 
were also clear. At one school, there was very little dif- 
ference in initial achievement for many of the skills, and 
substantial gains were made for only two objectives, with the 
percent correct for one objective declining by test time 3. At 
the other school there was considerable difference in initial 
scores. Steady gain'-^ across test times occurred for four 
objectives, with small gains in two additional areas and 
achievement declining in one area over time. 

Grade 5. The pattern of reading instruction was quite 
different at the two schools. While students were self-paced 
^1% of the time at one school, self-paced settings were ob- 
served 88% of the time at the other. Large group instruction 
was observed ^46% of the total period at the first school, but 
at the second school it accounted for only 7% of the available 
time, with nearly three-fourths of the instructional period 
spent in individual work and 20% in small groups. Although 
both schools relied heavily on paper and pencil materials, at 
the first school the':^e were used almost exclusively on a 
day-to-day basis. At the other, paper end pencil materials 
were always used in conjunction with printed material. 

There are also similarities between the two schools at 
qrade 5. Available time averaged about 75%, and students 
were engaged 76^. of the available time at each school or acout 
^^7^ of the allocated time. Little Word Attack time was sched- 
uled at either school. Skills instruction at the first school 
focused almost equally on Study Skills and Comprehension, 
while at the other Comprehension was allocated over four 
times as much. 

At cjrtuie S students evidenced only small changes in 
achievement for all but a small number of the 12 general 
objectives at each scfiool. The number of skills for which 
studerUs reached a ;nastery level of 80% on the achievement 
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monitoring tests wds not biynificantly larger at test time 3 
than at test time 1 at either school. A pattern of steady 
achievement across test administrations occurred for only two 
skills at each school. In none of these instances of growth 
did students reach a level of 80% correct, and in three of the 
cases the overall gains were not large. 

Allocated time. Time allocations were adjusted to reflect 
the average number of minutes allocated to the children who 
received instruction rather than the average number of minutes 
per child. Overall, relatively large differences existed be- 
tween the amount of time which was allocated and the amount 
of time the developers considered necessary for continuous 
skill development and mastery. In that less than the minimum 
recommended amount of time was allocated, especially to Word 
Attack at grade 2 and to Study Skills and Comprehension at 
grade 5, it is not surprising that there are ery few large 
gains in achievement over the investigation period. Thus, 
the nonsignificant correlations between time and achievement 
probably occurred because an insufriclent amount of time was 
cillocated to instruction, resulting in small and relatively 
unstable changes in students' performance. 



Grade 2. The length of the class period was nearly the 
same at both schools, ranging between 35 and 40 minutes. 
Three-quarters of this time was spent in activities related to 
specific mathematics objectives. At both schools paper and 
pencil materials were used approximately 60% of the allocated 
time. Manipulatives were used for nearly one-third of the 
time. This relatively high use of manipulative materials is 
most likely associated with DMP, reflecting the program^s 
emphasis on their use. Cams were seldom used at either 
school. The main type of interaction was teacher to group, 
occurring from 11V, to 14% of the time at both schools. The 
patterns of the other interaction types were very similar at 
both schools. 

The nuiin varidtinns in instruction between the two 
schoolv wore in pacing and grouping. These two means of 
instruction appear to be more associated with the teacher, 
than with either school or program variables. Variations in 
grouping and pacing also occurred from day to day, more at 
one school thijn the other, indicating flexibility in their use. 
Als(j, withlrj the instructional group of one teacher, some 
vcjridtion m p^jclncj arui grouping existed between individual 
students, which suggests some individualization of instruc- 
tion . 



Results— DMP 
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At grade 2 th(! total allocated time for the two primary 
obiectives-"ad( on and subtraction computation and counting — 
was very similar* in the two schools, with computation alio- 
cated more time. One school spent a significant time on 
measurement/attributes and some time on geometry, whereas 
at the other only 31 minutes was spent on measurement with 
no time being spent on geometry. On the other hand, that 
school spent more time on writing sentences and fractions. 
Even though DMP is used at both schools there are differ- 
ences in which objectives are accorded instructional time and 
in the sequence of instruction. 

The students at one school began the period of investi- 
gation at a higher level of achievement on five of the seven 
tested objectives than did the students at the other school; in 
problem solving the schools were comparable and in fractions 
students at the first school were lower. 

The patterns ot achievement are similar between the two 
schools on writing sentences, computes ( + /-), counting, 
inequalities, and measurement/attributes which can be par- 
tially explained by both schools using DMP. The schools 
differed in the increase of achievement on fractions and 
problem solving. Overall, the differences in achievement 
between the two schools appear to be related to the dif- 
ferences in content covered rather than to differences in the 
means of instruction. 

Grade 5. Very few common features were observed in 
the means of instruction at the two schools. Paper and pencil 
materiiils were the main materials used, although to a much 
larger extent at one school than the other school. Very little 
use v.as made of small groups, manipulatives , or games at 
eithei^ school. The dissimilarities between the grade 5 classes 
at the two schools a-e numerous. Self-paced individual 
activities were used extensively at one school, but only about 
one-fourth of the time at the other. The teacher at the first 
school spent a large proportion of the allocated time talking to 
the whole group of students, whereas only one of the teachers 
at the other school used any teacher-to-group interactions 
cind usually for only 5 minutes at the beginning of the class 
period. 

Because of the large variance between the schools, there 
appear to be no common means of instruction that can be 
rclcitod to the common curriculum program, DMP. The means 
dppear to be more a function of the teacher. 
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The two schoolb differed noticeably in the content cov- 
ered during the investigation. At one school instruction was 
confined to two general objectlvas—fractions and decimals. 
The teacher commented that he prefers to teach the topics 
related to one strand, such as fractions, rather than take the 
topics in numerical sequence. In contrast, at the other 
school where two classes participated in the study, in'itruc- 
tional time was spent on a range of general objectives. 
However, one general area received the major part of class- 
room time early in the study, multiplication and division 
computations, and emphasis later shifted to a second area, 
fractions. 

Non-DMP materials, primarily worksheets taken from 
other commercial sources or made by the teacher, were used 
at both schools. As the school y^jr progressed the trend 
was to use these materials to provide the students more 
practice on skills. 

The percentage of engagement at both schools was 
similar and averaged approximately 70% of the available time. 
Thus, the variance in content covered was due more to what 
time was allocated to particuhr r^neral objectives than to 
variance in the engager s.ur^^nts during classes. 

Thus, even though both schools we; e using DMP as the 
main matliematics program at grade 5, the use of the program 
varied grea.i\ This indicates fitxibility in the use of D^.P. 
At neither sc lool was DMP used exclusively. 

Achievr lent differences between the two schoo's reflect 
differences ;n when instructional time was spen* on objec- 
tives. At one school students began with some competency in 
multiplication ond division and n,ade large increases in 
achievement first on fractions concepts and computation and 
then on decimals-computation. The relatively low scores on 
most objectives tor test time 1 provide evidence that the 
students were grouped closely in their achievement. In 
contrast, the initial scores on objectives for the other school 
were moderately high. .50 or above, and there was large 
variaoMity among students, which suggests that more empha- 
sis was placed on indiv . Jualization at that school, Also, 
moderate increases in achievement over the periods provide 
additional evidence that perhaps not all of the students were 
given instruction on the same objectives at the same time at 
that school. 
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The fin<il levuls uf achievement are similar for both 
schools on fractions-computation, decimals-concepts, computes 
(x/t), and problem solving despite the differences at the 
beginning of the investigation and the varying instructional 
approaches. The similarities between the two schools in 
student outcomes appear to be, at least in part, associated 
with both schools using DMP. Some of the Scme topics were 
used at both schools. 

The differences in studer^t outcomes between the two 
schools appear related to how the materials were used and the 
sequence in which topics were given. Selected topics were 
used at one school allowing more advanced topics to be pre- 
sented. At the other school a larger number and a wider 
range of topics were used. However, students did not ad- 
vance as far on particular topics such as decimals. This 
difference in the topics covered resulted in the 'argest 
difference in achievement between the two schools, which 
occurred on decimals-computation at test time 3. 

Summary of the 
Descriptive Studies 

From these studies we oeiieved adequate evidence was 
available that each of the programs can be effective in getting 
students to master specific objectives and skills. The evi- 
dence is more convincing for PRS and DMP than for WDRSD, 
but steady improvement on some leading objectives was ap~ 
parent. 

However, what was mere obvious was that how time was 
cillocated and instruction carried out varied considerably 
between teachers. !n particular the time allocated to dif- 
ferent content objectives, the sequence of instruction, and 
the grouping of studerLs differed dramatically from class to 
class . 

THE IGE/WDRSD 
COMPARATIVE STUDY 

Procetlure 

The purpose c*" this study was to examine three questions: 

1. What are the effects on reading skill instruction of 
using the WDRSD in an ICE and a non-IGE school enviroriment? 
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2. What are tht* effects on reading instruction of using 
the WDRSD and using other reading programs in the ICE 
school environment? 

3. What are the relationships amen the variables 
presented in Figure 8-1? 

To answer these questions, data were gathered from a 
sample of ICE schools using the WDRSD, a sample of non-IGE 
schools using the WDRSD, and a sample of !GE schools using 
other reading programs. A full report of the study was 
provided by Romberg, Stewart, Webb, Nerenz, Puliiam, and 
Srivastava (1 982b). 

Data were gathered for this comparative study from 
October 1978 until May 1979 from studen .s in grades 2 and 5 
and their teachers. As In the descriptive studies, data were 
collected by four means: tests on general objectives of 
WDRSD, observations of specific students during the reading 
instruction period, teacher logs for reading instruction of 
specific students, and questionnaires which served as the 
basis for structured interviews with school staff. 

For each of the three school typos— IGE/WDRSD, IGE/non- 
WDRSD, and non-ICE/WDRSD--schools were matched according 
to community size, socioeconomic level, composition of student 
body, size, and for ICE schoolr. "IGEness.^' Communities 
represented were extreme rural, small place, medium city, 
and urban fringe. One urban fringe ICE school not using 
WDRSD withdrev^ from the study just prior to the beginning 
of data collection, bringing the number of schools in this 
study to 11. Differences in operating characteristics, or 
background variables, among the three types of schools were 
anticipated to predict differences in the way instructional time 
was used; time use, ir, turn, was anticipated to predict 
student performance on objective-abased assessments. How- 
ever when schools were compared on the four background 
variables which reprerent ICE characteristics (the first four 
school variables in Figure 8-1), the non-IGE schools proved 
to htive the highest average on two variables and were be- 
tween the two groups of ICH schools on one variable. Thus, 
in this sample, schools using the ICE label were not opera- 
tionally different from schools not using the label. 

DcUd were grouped for analysis at three progressively 
more sprtific levels, the most inclusive bei ^.g the content area 
followed by the general objective and the specific objective. 
In the WDRSD, reading skills with specific behavioral ob 
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lives cire orgcU»i/::(i into three content areas: Word Attack, 
Comprehension, and Study Skills, Within each of these 
content areas, from two to five general objectives were devel- 
oped for the present study, based on the specific objectives 
of WDRSD. The general objectives used in the study for 
grades 2 and 5 are shown in Table 8-2. The content aggre- 
gation for reading skills instruction was used with the teacher 
iogs, classroom observations, and achievement monitoring 
tests. 

The actual dependent variables used in this study were 
tfie residualized mean gain scores (final scores adjusted for 
differences on initial scores) calculated for 13 variables at 
grade 2 and 11 variables at grade 5 (see Table 8-2). 

The results of the ICE/WDRSD comparative study are 
summarized in t3rms of six categories of information: time 
use, achievement results, and relationships between time use 
ciruJ achievement for grades i and G separately. Because of 
their si/e, tables reporting results are in the appendix to 
this chapt3r, numbered 8A-1 tnrough 8A-4. 



Time allocated to reading instruction, the amount of time 
A tedclier inter ded to spend in various reading instruction 
tctivitits, is a gross measure of opportunity to learn. The 
number of hours allocated overall indicates the relative 
importance of reading in the elementary curriculum at various 
schools. Broken down by objective, allocated time informs us 
about the focus of instruction at various schools. In Table 
8A-1 a summary of the time allocated to content areas is 
presented; these data come from teacher logs. 

Word Attack skills received the primary instructional 
emphasis in reading at grode 2 with most schools allocating 
from one-half to t\/o-thirds of the skill time to that area. 
Study Skills were taught very little at the non~WDRSD 
scnools, and not at all at three of the eight WDRSD schools. 
At throe of the non-IGt/WDRSD schools, over one-third of 
tfie skills instruction time was allocated to Study Skills. 
There seenr. to be two distinct ideas about li.^ tp?*hing of 
Corrprehension skills in grade 2: Three schools, all WDRSD 
schools, allocated no time to instruction in Comprehension 
skills; cit th- other eight schools about one-third of the skiUs 
ir^struction time was allocated to Comprehension. 



Grade 2 Results 
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Table 8-2 

Student Achievement Variables for the WDRSD 
Comparative Study 



Variable 



Grade 2 



Grade 5 



01 Phopic /\iialyslH — Consonants 

02 Phonic Analyses — Vowels 

0 3 Phonic /Xnalysis — Silent Letters 

04 Structural Analysis 

03 Vocal- iary Moaning 

13 Word Attack 



/ 
/ 

/ / 

/ / 
/ 

0 1+02+0 3+04+05 0 3+04 



()() Map Skillj^ 

0 7 Graoh and Tab^ Skills 

08 Keforonce Ski lis 

14 Study Skills 



/ 

06+07+08 



/ 
/ 
/ 

06+07+08 



09 Word Meaning Skills 

It? Sentonco Moaning Skills 

11 Passage Itoanlng Skills 

13 Coi.iprehons ion 



/ 
/ 

10+11 



/ 
/ 
/ 

09+10+11 



12 GLMicral kfading 



i\ote: Variables 01-11 are general objectives; variables 13-15 are 
content areas. Variable 12 is for basal reading groups 
which were logged and observed in 4 of the 11 schools* 
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Obviously theri! dre r.o consistencies apparent among the 
eight ICE schools or the seven WDRSD-users in terms of time 
allocat'jd to the content areas of reading. There was consid- 
erable variation among the schools on each of the time use 
variables, and no similarities were found related to either ICE 
or WDRSD. The only conclusion that is warranted is that 
what operationally constitutes a reading -ogram at grade 2 is 
distinct in vta^^b. classroom. 

Use of different group sizes, different types of mater- 
ials, and incidence of teacher- and student-initiated inter- 
c3cti()ns were examined in terms of percent of available times. 
At all ICE/WDRSD schools large gro ips were used extensively, 
but the schools di<^fered in their use of individual and small 
groups. Similarly, at all :GE/non-WDRSD schools, individual 
work was predominant, but small and large groups w^re used 
for different percentages of time at the three schools. In use 
of ,Tir*erials no totally consis<'enl patternr, were found. 

Achievement data were gathered eight limes in each 
school on all specific objer'ives. The data vvare then ag- 
cjregatec for general objectivei, and content areas. To simp- 
lify this discussion only the .ygregate data for the three 
content areas from thi: first and last administrations are 
reported hi e. Both actual change and relative change from 
time 1 lo tune 8 are presented. 

The r;»^tual change, -f course, is an increase during the 
school year from time 1 to time 8, an actual gain in achieve- 
ment. Since scores differed at time 1 and at time 8 and since 
the proportion of change wab different among schools, the 
relative change in achievement differs among schools. Rela- 
tive change is expressed as residualized mean gain scores, or 
residuals; these scores are both positive and negative even 
when actual achievement increased for all schools. The 
summary data for grade 2 reading achievement are shown in 
Table 8A-2. 

For Word Attack and Comprehension, scures at time 1 
were moderately high, thus lea/ing littie '^poortunity for 
substantial gains on those tests. Yet, pcfitive actual gains 
were exhibited in each school 'n each area. There was very 
little difference among the three groups of schools and much 
overlap In the rcores of schools. 

The emphasis in this study was on identifying instruc- 
tional patterns that are particularly effective in raising 
childre.i's ach»^ ement. There were no distinct instructional 
patterns in the schools that had high achievement gains. We 
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feel tfidt instructiof^ the relatively less effective programs 
was not well targeted; that is, instruction seems to have been 
provided less on the basis of individual instructional nerds 
than on the basis of skills customarily taught at grade level. 

The contrast between school 476 and school 493 for 
second grade instruction in V/ord Attack provides a striking 
example of the effect of targeted instruction. School 476 
had the highest score at time 1; all of the reading skill 
instructional time was allocated to Word Attack; the score at 
time 8 was above average but the score gain was less the 
average. School 493 had a nearly average score at time 1; 
about two-thirds of the reading skill time was allocated to 
Word Attack; the score at time 8 was the same as that at 
school 476; the score gain at school 493 was half again as 
high as the average. 

For Comprehension skills, achievement at time 8 was 
quite high at all schools and outstanding at school 451. 
Again, at this school, the emphasis on comprehension skill 
instruction was no -eater than at most other schools and the 
instructional pattern did not differ from other less effective 
patterns. We conclude that instruction was well targeted. 

Grade 5 Results 

In Table 8A-3 a summary of the alloc- time to content 
area is presented; these data came from tecjcner logs. 

Word Attack skills were taught at grade 5 in only two 
WDRSD schools and in all three non-WDRSD schools. These 
results are consistent with the developers' expectations; the 
Word Attack element of the WDRSD was designed to end formal 
skill instruction between thin and fifth grade, with rein- 
forcement and application con. g during basal reading 
groups. 

The five schools that provided Word Attack skill in- 
struction allocated a relatively smaller proportion of their 
reading time to Stud ' Skills than did other schools. At 
school 903 no time was allocated to Study Skills duri j the 
skill period. In contrast, at schoo' 900 virtually all skill 
instruction time was allocated to Study Skills. 

In 9 of the 11 schools, about hali of the grade 5 skill 
instruction time was allocated to Comprehension skills. The 
two exceptions differed not only from the other sch'^ols but 
also from one another. At school 90:>, nearly all of ihe skill 
instruction focused on Comprehension; at school 900, no skill 
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tinie Wtis <ill{K:c)t(>(l to Conipvef lunsion , The importance of Com- 
prehension skills at 10 schools is the .nost consistent time use 
finding . 



Observitional data on time use are reported in detail in 
the complete report. The percentage of nonapplied tjme 
virieci among schools, averaging 19% of the allocated time, 
fcxtreme deviations occurred at schools 446 and 902, where 
nearly one-third of the allocated time was nonapplied time, 
jnd at school 410, where only 3% of the allocated time was 
nonapplied. 

Students were engaged in instructional activities nearly 
two-thirds of the time, on the average. School 466, where 
students were engaged only 50% of the time, and school 410, 
where students were engaged 89% of the time, were again 
exceptional. At school 900, where the percentage of non- 
applied time had been average, engaged time was only 55% of 
the allocated time. 

Finally, for the means of instruction variables — group 
^>lzes, prirrujry types of materials, and incidence of teacher 
and student interactions--no consistent patterns were apparent. 

At grade 5 the same strategy of reporting proportion 
correct at times 1 and 8 with actual and residual mean gain 
scores was followed (see Table 8A-4). As at grade 2, for 
most objectives average scores were at a moderately hiah level 
at time 1. Most scores for all objectives increased from 
time 1 to time 8. 

The group of non-ICE/ WDRSD schools showed more posi- 
tive average change on all three aggregate objectives than 
either of the groups of ICE schools. ICE/WDRSD schools had 
higher positive gains than ICE/non-WDRSD schools on both 
Word Attack and Stud -' Skills. The average differences are 
slight; score ranges tor all three groups overlap considerably 
on both Word Attack and Comprehension. 

L.cjrge achievement gains in Word Attack skills occurred 
at two of the schools that allocated no tinie to formal skill 
instruction in Word Attack, schools U51 and 902. Only s'.ill 
instruction jnd not the t()tal reading program was studied in 
these schools so knowledge of the reasons for the iniprove- 
n^ent is not available. 
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In btudy Skills, .ibove overage dchievement gains were 
made .it schools 900, 902 , and 901. These gains were not 
extremely large and did not lead to impressivel. high achieve- 
ment at time 8. No distinct instructional pattern was ob- 
served <it these three schools. 

In Comprehension, the achievement gain was dramatic at 
school 410 and large at schools 507, 902, and 901. At school 
410, the total reading period was logged and observed; per- 
haps the small groups were a pai'ticularly effective mechanism 
for improving Comprehension skills at that school. Because 
only skills instruction was observed at other schools, where 
no instructional pattern emerged, we cannot draw any conclu- 
sions about the effectiveness of the basal reading groups in 
increasing achievement on specific Comprehension skills. 

THE IGE/DMP COMPARATIVE STUDY 
Procedure 

As in the WDRSD study, the purpose was to examine 
three questions; 

1 What are the effects on mathematics instruction of 
usincj tfie DMP mathematics program in an ICE and a non-IGE 
school environment? 

2. What are the effects on mathematics instruction of 
using DMP and using other mathematics programs in the ICE 
school environnient. 

J. Whtit are tfie reUitionships among the variables 
presented in Figure 8-1? 

To answer tfiese questions, data were gathered from 
throe samples of schools: ICE schools usi*- i DMP, non-ICE 
schools using DMP, and ICC schools using other mathematics 
procjrans . 

PjI.j were qtithorod during the 1978-79 school year from 
stucients in grades 2 and 5 and their teachers. As in the 
other studios data were collected by four means: tests on 
general objectives of DMP, observations, teacher logs, and 
struf turtle! interviews leased on questionnaires. More detail is 
.iv.ul.'ble in Kofnl)crg, Stewart, Webb, Nerenz, Pulliam, and 
Snvastuva (19B2a), 
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Table 8-3 

Student Achievement Variables for the ICE/DMP 
Comparative Study 



General Objective Grade 2 Grade 5 



01 Writing Numbers / 

02 Inequalities / 
0 3 Other Place Value or Numeration / 

Place Value and Numeration (16) 01+02+03 



04 Addition/Subtraction / / 

05 Multiplication / / 

06 Division / 

Operations (;7}iole Numbers) (17) 04+05 04+05+06 

07 Concept / ^ 

08 Fractions Compuces / 

Fractions (18) 07 07+08 

09 Decimal Concept / 

10 Decimal Computes j 

Decimal Fractions (19) 09+10 

11 Moasurenient / / 

12 Word Problems / / 

13 Applications / / 

*'*-Dblcm Solving (20) 12+13 12+13 

14 Geometry / j 
lb Miscellaneous / / 
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For Gcich of the thre^ types--lCE/DMP, ICE/ron-DMP, and 
non-ICE/DMP--schoois were matched as in the WDRSD study. 
Communities represented were extreme rural and small place, 
medium city, and urban fringe* One medium city ICE school 
using DMP withdrew from the study just prior to the beginning 
of the data coPection, bringing the number of schools in this 
study to eight. 

As before, differences in operating characteristics among 
the three types of schools, background variables, were anti- 
cipated to predict differences in the way in which instruc- 
tioriHl time was used; time use, in turn, w.ts anticipated to 
predict student performance on objective-based assessments. 
As in the ICE/WDRSD comparative study, when schools were 
compared on the four background variables which represent 
ICE operating characteristics, the distinctions between groups 
were not apparent. For 'cwo of the variables, the non-lCE 
schools averaged slightly above one of the groups of ICE 
schools and had ranges that overlapped those of both groups 
of IGt schools. The overlap also occurred with one group of 
IGE schools on a third variable. Thus for these ICE-related 
scores, the label ICE school was not useful in grouping 
schools. 

To aggregate the data the basic strategy used in the 
IGE/WDRSb comparative study was followed. Pupil perform- 
ance data on specified program objectives were gathered and 
^QQi^sgated into 23 general content objectives. These general 
objectives were organized into eight content areas: place 
valuer and numeration, operations (whole numbers), fractions, 
decimal fractions, leasurement, problem solving, geometry, 
and miscellaneous. While the same content areas are used for 
both grades the general and specific objectives differ as 
shown in Table 8-3. Results are tabulated in the appendix to 
this chapter in Tables 8A-5 through 8A 8. 

Grade 2 Results 

Th.e total hours of matheniatics instruction per child and 
tilt.* tJSbignmont of those hours to the 11 general objectives for 
(jr.,Je 2 ,]rv. given in Table 8A-5. Overall, hours allocated 
during the 25-week study ranged from just over at school 
33 to over 90 at schools 593 and 906. Clearly, addition and 
subtraction of whole numbers is the heart of tfie second-grade 
mHthematics program, regardless of curriculum program used. 
At the D^AP scfH)ols, writing numbers anc /vord problems both 
had a substantial proportion of time allocated. At the non- 
|(':»F'DMP schools, over 10?, of the lime was allocated to frac- 
tions. At the various scliools, different general objectives 

181 



133 



had he(»n iclentitu?<l fur iicJciitioncii eniphas»s: geometry at 
schools 440 and 762; rniticeiluneous topics at schools 593, 428, 
421, one! 33j; and other place value also at school 421. At 
school 906, time was allocated to only 7 of ihe 11 general 
objectives; dt other schools, time was allocated to 9 or more 
of the objectives. 

Eacli uf the ICE/DMP schools allocated over three- 
quarters of the mathematics instruction time to three basic 
objectives: v/ritiny numbers, addition and subtraction of 
whole nurTibers, and word problems. 

Also, at two of X\^e three non-ICE/DMP schools, about 
tliree-quarters of the time was allocated to the three basic 
objectives; at the third, nearly two-thirds. At least 11?, of 
the tirr.e at each of those three schools was allocated to 
measurement of length and capabity, much more time than at 
other schools. 

At the three ICE/non-DMP schools, addition and subtrac- 
tion was the only basic objective to be scheduled for a large 
proportion of time and the proportion was larger than in the 
other- two types of schools. The miscellaneous topics such as 
time, money, and qrsip'ns were allocated a fair proportion of 
time at two schools, one or which also allocated considerable 
time to place value and numeration. At the third school in 
this group, the relatively little time not allocated to addition 
and subtraction was spread among four other objectives includ- 
ing the miscellaneous topics. 

Thus overall there was a distinct difference in what 
constituted the mathematics program at grade 2 depending 
upon wtiettier DMP was the program or not. 

In contrast, the aggregated observational data on time 
use show XhiiX there is no consistent pattern of how instruc- 
tion proceeds in the groups of schools at second grade. 
Observations were made during the time period in which 
matfiematics instruction was sctieduled in each school. Al- 
thou(jh there was variation among the schools on nonapplied 
time, cjvaildble time, and engaged time, it is not consistent 
for groups. For two of the means of instruction variables 
there was a hint of a pattern. At four of the five DMP-user 
schorls there was a more balanced use of grouping patterns 
than at ttie non-DMP schools wnere Instruction was predomin- 
antly indiviciualized with paper and f ncil materials. 
Similarly, manipulatives were used only in DMP schools. What 
is surprising is that at two DMP schools (one ICE and one 
not) there was little use of manipulatives. 
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As in tht» \(A /WOKbU cumparaMve study, achievement 
datd were gathered eight times for the specific objectives. 
To simplify comparisons only the data from time 1 and time 8 
ore presented with both actual and relative change. The 
summcjry data for grade 2 mathematics achievement are shown 
in Table 8A-6. 

In general, there was little variance in proportion cor- 
rect at test time 1 and greater variance at test time 8. The 
three non^lGE schoolr, '^Ui'^ *y scored lowest of the school 
groups while the two groups of IGE schools alternately had 
the highest average. Cains were generally very high posi- 
tive. In spite of the instructional emphasis on addition and 
subtraction at all schools, average gains were greater than 
,20 for four additional objectives. 

In the following paragraphs, results for each of the four 
aggregate objectives in mathematics are discussed in relation 
to time and means of instruction. The emphasis is on identi- 
fying instructional patterns that are particularly effectis ^ in 
raising children's achievement. 

For f^lijce value and numeration, students in schools 440, 
593, and 906 made above average achievement gains. Students 
were observed to be engaged more hours at these three 
bcfiools than at the other five. 

For operations, although addition, subtraction, and mul- 
tiplication were included in objectives for instruction, only 
addition and -subtraction were tested and very little time was 
allocated to multiplication at any of the schools. Initial scores 
were above average at schoois 593, ^21, 333, and 906. At 
schools 593 and 906 achievement gams were above average; at 
schools 421 and 333, below. At schools 421 and 333, students 
worked individually over 80% of the time. Individual work 
occurred a smalle.* proportion of the observed time at schools 
593 and 906 where large groups were more frequently observed. 
At school 906, extensive use of small groups was also observed. 
Pap^r and pencil materials, or worksheets, were in use about 
hcjit the time at schools 593 and 421 and nearly 90% of the 
cit school 333 and 906; both schools 593 and 906 used 
additional materials--primari ly printed materials at school 593 
and erUirely manipulatives at school 906— for nearly the same 
amount of V\mv workslieets were in use. In addition, there 
wi?re cnf)re interactions at schools 593 and 906. 

For fr.Jftions, the two schoois in which students made 
substantial gains, schools 440 and 904, were the two in which 
manipulatives were in use for a large proportion of the avail- 
tibiij time. 
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P-or prohhM.j solviiuj, only in the five DMP scliools was a 
subslantial proportion of time formally allocated and observed. 
The achievement gains at schools 428, 421, and 333 suggest 
that problem solving is an integral part of instruction on 
other mathematics objectives. Achievement gains were low for 
all three non-ICE/DMP schools, particularly so in school 906 
where over 40% of the mathematics instruction time was allo- 
caied to problem solving. The instructional pattern in this 
school was not different from the effective patterns at schools 
440 and 593. It seems possible that both allocations and 
observations did not include a clear distinction between the 
uperations of addition and subtraction i;nd the application of 
those skills in problem solving. 

Grade 5 Results 

In Table 8A-7 a summary of the time allocated to the 
general objectives is presented. Overall hours allocated 
cUifinq the 25-week study ranged from nearly 70 at school 593 
to ever 90 at bcliool 440. There was no general pattern of 
instruction ditferontiating the groups of schools, although the 
non-IGE/DMP schools were more similar than the other two 
groups. Division was the only general objective to v/hich all 
schools allocated a substantial proportion of time. All schools 
except school 593 also allocated at least 10% of the time to 
computing with fractions. At school 593, a third of the time 
was allocated to computing witli decimals, mucii more than at 
the other schools. 

The very small proportion of time allocated to word 
problems ard applications is disappointing. These objectives 
compribc the angregt^te objective problem solving which, for 
most adults, is the primary application for mathematics. 

The observational data present somewnat the same pic- 
ture; the percentage of nonapplied time, and of course avail- 
able time, did not vary greatly among schools. The largest 
percentage of nonapplied time was observed at the two iCF/DMP 
schools which were similar to each other. The non-ICE/DMP 
schools also were similar. 

Variability among schools increased for engaged time. 
ICE/non-DMP schools were similar to one another and had a 
higher average engagement rate than the other groups of 

schools. 

F'or the means of in^^^uction variables, four interesting 
cii.ferences were noted. *^st, in use of ttie three group 
sues ♦he two non- lCE/DMP schools were similar to each other 



114 



ERIC 




and different from the other two groups of schools; only in 
use of small groups, however, is there no overlap in the 
range of individual school scores. Second, the ICE/DMP 
schools had a much higher rate of teacher-initiated inter- 
actions than the other two groups. Third, In spite of DMP, 
manipulatives were rarely used In any school. And finally, 
school 333, an ICE/non-DMP school, is unique: All instruc- 
tion is directed to individuals; absolutely no large group 
instruction is provided; paper and pencil materials pre- 
dominate; a.Td there were virtually no obsen-ed teacher-pupil 
interactions. 

Achievement results are shown in Table 8A-8 which in- 
cludes, for each objective, proportion correct at times 1 and 
8, actual gain, and residual gain score. 

The most striking finding is the slight but consistent 
decline on addition/subtraction; only school U28 had a higher 
average at time 8 than at time 1, At both times 1 and 8, 
scores were highest for this objective. Scores were high at 
both times 1 and 8 for multiplication. 

The IGE/DMP schools had the highest average on six of 
the nine general objectives and three of the four aggregate 
objectives. However, differences amoncj the three groups of 
schools were small except for decimal computing and its 
aggregate. 

At grade 5, the identification of particularly effective 
instructional patterns is very difficult. For example, at 
school 905 instruction in operations was very successful; the 
achievement gain was more than double the average gain and 
was sufficient to bring the time 8 score very close to the 
average. At school 906 the instructional pattern observed 
was nearly identical to that observed at school 905; however, 
at school 906 the achievement g.-fin was slightly less than 
average. For operations at schools UUO and 333, where 
achievement changed very little from time 1 to time 8, the 
overall rate of materials use was much lower than at other 
bChools . 

For fractions, the Mse of manipulatives seems to enhance 
achievement. The only other apparent effect is of relative 
emphasis on fractions in the overall mathematics curriculum as 
indicdted by proportion of allocated time. 
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Only at school 593 wai. instruction on decimal fractions a 
major portion of the fifth-grade mathematics curriculum. 
Achievement gains were very large at this school and at 
school 906, although achievement levels at the two schools 
were very different. 

And finally, at no school was instruction in problem 
solving a significant portion of the mathematics instructional 
program, as shown by percentage of allocated time. At all 
schools, achievement gains were small from an initial level 
that was uniformly low. Instructional patterns were very 
similar at the three schools where problem solving instruction 
was observed. The small gains are consistent with the disap- 
pointingly low percentage of time allocated to problem solving. 



The information presented in this chapter is from five 
studies conducted as Phase IV of the ICE Evaluation Study. 
The four primary purposes of the Phase IV Evaluation Project 
reflect on our attempt to describe in considerable detail the 
actual operating characteristics of a sample of schools that 
were using the curriculum materials designed to be compatible 
with ICE. Based on these studies three primary conclusions 
are warranted. 

1. There is no obvious pattern by which the different 
learning environments at each grade level can be appro- 
priately grouped; one cannot confidently argue that any two 
classrooms (or units) operated in the same way. It appears 
that each learning environment is unique. The demography 

of the school, the way in which it is organized, the degree of 
implementation of var ous components of ICE, whether or not 
ICE-compatible materials are used, the way in which time is 
used in classrooms, the way in which instruction is actually 
carried out, and the level of achievement on different objec- 
tives present an interesting descriptive picture about each 
learning environment. However, there is little common from 
situation to situation. 

2. Whether a sci^ool calls itself ICE or not is not impor- 
tant. The label difference is not a good indicator of operat- 
ing differences \n the schools. 

ICE was not developed or dissemir'iated as a simple new 
ido<i. Rather IGE is a synthesis of ma.iy existing ideas 
which, implemented together, represent a comprehensive 
alternative to traditional schooling. It is not surprising. 
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then, that schools not using the ICE label have characteris- 
tics that one would expect in an ICE school. Similarly, it Is 
not surprising that there are "nominal" ICE schools, as 
described in chapter 4, which differ little from traditional 
schools. 

3. Whether schools use IGE-compatible materials (PRS, 
WDRSD, or DMP) is important if the content of those materials 
differs from traditional materials. The key here is allocated 
time. If other content of programs differs, then time is 
spent differently and achievement differs. This appears to 
be the case for both PRS and DMP. However, for WDRSD, which 
is basically a skills management system, the differences 
be 3en WDRSD users and WDRSD nonusers were not generally 
apparent. 

In addition to these general conclusions the following 
seven findings need to be noted. 

1. If time is reasonably allocated to objectives, then 
students' performance does improve. Also, if little time is 
allocated to instruction (such as fractions at second grade), 
then little change in achievement is shown. However, even 
though a lower bound of allocated time is needed to increase 
achievement in any area, the relationship of allocated time to 
performance is not linear. For example, at second-grade 
reading, the variability in time allocated to Word Attack skills 
is not related to achievement, since all schools spend a lot of 
time on these skills. In fact, some schools are probably 
spending too much time for the relative payoff. 

2. Particularly in reading instruction, while much time 
is allocated to reading, what is actually taught — relative 
emphasis o^ specific objectives— differs greatly across classes. 
This variation might be appropriate if the differing emphasis 
retiected the needs of the students and was in turn reflected 
in improved performance. However, a great deal of time was 
allocated to specific skills with little apparent gain in per- 
formance. Part of the lack of gain occurred because achieve- 
ment at time 1 on most objectives was fairly high. Part is 
due to the fact that items for a general objective were not 
necessarily related to all the subskills, and time may have 
been spent on untested subskills. However, the most likely 
explanation is that teachers seem to have chosen to base 
reading instruction in their classes on what they customarily 
rover at each grade level rather than on individual needs, 
and what they customarily cover is idiosyncratic. 
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3. At grade 2, the non-DMP users did not allocate time 
to solving word problems. This objective is emphasized in 
DMP. The differences in problem-solving performance be- 
tween DMP and non-DMP groups clearly favors the use of 
DMP. Similar differences at grade 5 were not found since 
little time was allocated to problem solving in any class. 

4. An unanticipated finding in grade 2 mathematics was 
that there was no pattern of differences favoring the non- 
DMP users on the operations of addition and subtraction until 
the beginning of third grade, the activities at grade 2 are 
designed to develop the concepts underlying those skills. 
Thus, the amount of time allocated for addition and ^ubtrac- 
tion should have been less at DMP schools, and performance, 
in turn, should have been lower. Neither was the case. 
DMP users seem to have modified the program so that the time 
allocated to computation was similar to that allocated by 
non-DMP users. For all schools, we believe an inordinate 
amount of time is spent on addition and subtraction skills at 
grade 2, with not enough time allocated to other important 
parts of mathematics. 

5. Totally individualized instruction with children 
working independently on worksheets is detrimental. For 
example, in school 333 at grade 5 in mathematics, where this 
is the only way in which instruction is carried out, the 
approach produced low achievement. 

6. For some of the mathematics objectives (fractions, 
place value and numeration, for example) the use of manipul- 
ative materials in instruction is a very effective means of 
improving achievement. 

7. Some interactions of children with other children or 
with teachers are needed. Again, in grade 5 mathematics at 
school 333, there are almost no interactions, and the chil- 
dren's performance is disappointing. 

On reflection, it is now clear that self-declaration as 
"IGE school" or "WDRSD user" or "D.V^ user" is not an 
adequate basis tor testing either the use of IGE's instruc- 
tional programming model or the use of the particular in- 
structiorv-)' materials. For both, a school's use of the label is 
no guarantee that the ideas associated with either the in- 
structional programming model or the program are b'^ing 
followed. In fact, what seems to be the case is that the 
underlying conceptual ideas which guided the developers of 
ICE or WDRSD or DMP are not clearly reflected in the way in 
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which instruction is carried out. This conclusion may be an 
artifact of the samples chosen or it may be more pervasive. 
In fact, it may be unreasonable to expect people to change as 
much as was expected in an ICE/WDRSD or ICE/DMP setting. 
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Table 8A-1 

Grade 2 Allocated Hours to Reading Instruction 
Per Child Over the Total Study t^eriod 



School 



Word Attack 



Skill Inatructlon 
Study Skills 



Hours 



Total 
Skill 



Hours 



X 

Total 
Skill 



Comprehension 



Hours 



X 

Total 
Skill 



ICh/WORSlJ 

451 
A 76 

so; 



31.6 
8.7 

23.5 



71 

61 
100 
57 



1.3 
7.3 



9 
18 



13.0 
4.2 

10.7 



29 
30 

26 



IGK/nonWnKSI» 

372 
410 
49 3 



112.0 
15.8 
36.2 



64 

60 
65 



9.8 

.8 
2.1 



54.3 
9.8 
17.3 



31 
37 
31 



non IGK/WDHSI) 

900 
90.» 
901 
90 J 



8.2 
28. 5 
38. 1 
12.8 



4V 
61 
39 
59 



8.4 
18.6 
33.2 



51 
39 
34 



25.9 
6.8 



27 
41 



*Hours of general reading were estimated from reported total alloca- 
tion to reading and Jillocacion to ikilla* 
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BEST COPY AVAILABLE 



Skill Initructlon 



Total General Reading 



X X 

Total Total Total 

HouiH Hours Hours Hours Hours 



4<. 


.6 


23 


178 


.4" 


77 


23''. 0* 


U 


.2 


15 


80 




85 


94.7* 


24 


.3 


13 


158.0 


87 


182.3 


41 


.5 


23 


141 


.1* 


77 


182.6* 


176, 


.1 


76 


55, 


.4 


24 


231.5 


26. 


.4 


41 


37. 


9 


59 


64.3 


55. 


.6 


58 


40. 


.0 


42 


95.6 


16. 


6 


20 


67. 


9^ 


80 


8^1.5* 


47. 


1 


25 


141. 


3* 


75 


188.4'"* 


97. 


2 


68 


45. 


5 


32 


142.7 


21. 


6 


33 


43. 


2* 


67 


64.8" 



tS3 




Table 8A-2 

Grade 2 Reading Achievement Scores (Proportion Correct) 



Contenc Area 



Wonl Attack Study Skills 



School 


Time 1 


Time 8 




Res Idual 


Time 1 


Time 


I(.h./wi)k.si) 


















.56 


.6A 


+ 


.08 


-.06 


.50 


.57 




. 56 


.71 


+ 


.15 


+ .01 


.A9 


.7A 


A/6 


,67 


.78 


+ , 


.11 


-.02 


.61 


.67 




.6: 


.7A 


+ , 


. 1 3 


-.01 


.51 


.72 


Avr raf',»» 


.6U 


. 7? 


+ , 


.1? 




.53 


.68 


I(;K/n.u) WI;K-.|) 


















. 52 


.67 


+ , 


,15 


+ .00 


.A7 


.60 


AlO 


.57 


.7? 


+ , 


,15 


+ .01 


.52 


.65 


A9 i 


.57 


.78 


+ . 


21 


+ .07 


.A5 


.56 


Ave rvtg** 


.55 


.72 


+ . 


17 




.AS 


.60 


noil- IGK/WDkSl) 
















9no 


.61 


.73 


+ . 


12 


-.02 


.56 


.69 




.65 


.8i 


+ . 


18 


+ .05 


.38 


.71 


9(Jl 


.6A 


. 7A 


+ . 


10 


-.03 


,67 


.7A 


90 1 


. 5A 


.63 


+ . 


1 A 


-.01 


.A5 


.56 




.61 


.75 


+ . 


lA 




.57 


.68 


Gr.tnd Mvan 


. 59 


.73 


+ 


lA 




.53 


.66 
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BEST COPY AVAILABLE 



Content Area 
Study Skills Comprehension 



Change 


Residual 


Time 1 


Time 


8 Change 


Residual 


+ .07 


-.0/ 


.78 


.80 


+ .02 


-.02 


+ .2S 


+ .11 


.70 


.91 


+ .21 


+ .08 


+ .06 




.69 


.81 


+ .12 


-.02 


+ .21 


+ .08 


.73 


.82 


+ .09 


+ .00 


+ .15 




.73 


.84 


+.11 




+ .13 


-.02 


.71 


.84 


+ .13 


+.01 


+.n 


+ .00 


.78 


.84 


+ .06 


+ .04 


+ .11 


-.04 


.71 


.81 


+ .10 


-.02 


+.12 




.73 


.83 


+ .10 




+.n 


+ .01 


.68 


.83 


+ .15 


-.00 


+ .n 


+ .0:' 


.68 


.84 


+ .16 


+ .01 


+ .07 


-.01 


.70 


.79 


+ .09 


-.04 


+.11 


-.04 


,77 


.77 


0.00 


-.04 


+.11 




.71 


.81 


+ .10 




+ .13 




.72 


.82 


+.10 





ERIC 



1SS 

203 



Table 8A-3 

Grade 5 Allocated Hours to Reading Instruction 
Per Child Over the Total Study Period 



School 



Word Attack 



Hours 



X 

Total 
Skin 



Skill Inacructlon 
Study Skills 



Hours 



X 

Total 
Skill 



Comprehens ion 



Hours 



X 

Totnl 
S ill 



lCE/WDR5>lj 

466 
431 
476 



6.6 



41 



2.4 
5.9 
9.8 



15 
60 
45 



7.1 
3.9 
11.6 



44 
40 
55 



ICt:/non WnKSh 



372 


27.1 


28 


10, 


.8 


11 


60, 


.3 


61 


410 


16.2 


29 


15. 


.7 


2S 


24. 


,9 


44 


49 3 


6.9 


22 


9, 


.3 


30 


14. 


.7 


48 



non-lGK/WUKSI) 



900 


. 1 


Of 


1A.6 


100 




90; 






17.1 


46 


19.8 54 


901 


11.7 


l/i 


31.9 


39 


37.6 46 


901 


.7 


3 






19.1 96 


lours 


of general reading were 


estimated 


from reported 


total alloca-- 



tlon to reading and allocation to skills* 



BEST COPY AVAILABLf 
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1SS 

2:a 



' 4 



Skill Instruction 



Total 



Hours 



X 

Total 
Hours 



General Reading 



Hours 



X 

Total 
Hours 



Total 
Hours 



1ft. 1 


13 


104.7* 


87 


120.8 


9.fl 


30 


22.8* 


70 


32.6 


21.6 


11 


1/2. 8" 


83 


187.8 


98.2 


67 


48.2 


33 


U-6.4 


56.8 


50 


56.9 


50 


113.7 


30.9 


35 


57.9 


65 


8a. 8 


U.7 


n 


94.5* 


87 


109.2 


If.. 9 




73.8* 


67 


110.7 


81.2 


7/ 


24.7 




105.9 


19. « 


31 


39.6* 




59.4 



BEST COPY AVAILABLE 
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Table 

Grade 5 Reading Achievement Results 



Content hetA 



Word Attack Study Skill* 



School 


Time 1 


Time 8 


Change 


Residual 


Time 1 


Time 


tGK/WURSU 
















.59 


.55 


-.04 


-.08 


.43 


.52 




.48 


.70 


+ .22 


+ .11 


.58 


.59 


476 


.61 


.59 


-.02 


-.04 


.49 


.59 


50/ 


.61 


.60 


-.01 


-.03 


.60 


.66 


Averaye 


.37 


.61 


+ .04 




.53 


.60 


IGK/noiiWDRSI) 














372 


.47 


.46 


-.01 


-.11 


-43 


.46 


AlO 


.45 


.57 


+ . 12 


-.01 


.54 


.55 


49 3 


.72 


.64 


-.08 


-.03 


.58 


.66 


Ave rr.gi' 


.55 


.56 


+ .01 




.52 


.56 


noci-ICK/W[)R:.|> 














900 


.59 


.65 


+ .06 


+ .02 


.53 


.67 


902 


.59 


.RO 


+ .21 


+ .17 


.53 


.67 


901 


.5^ 


.64 


+ .09 


+ .03 


.39 


.54 


90 J 


.59 


.6? 


+ .01 


-.01 


.49 


.58 


Avt* r .ij;*' 


.58 


.68 


+ .10 




.49 


.62 


CiratiJ Mi'.m 


.5/ 


.6? 


+ .05 




.51 


.59 



191 

2)6 



Change Residual 



+ 


.09 


- .01 


.63 


+ 


.01 


- .06 


.69 


k 


. 10 


4 .^1 


.68 


f , 


.08 


¥,U 


.67 


4 


.0/ 




.56 


♦ , 


.03 


-,0? 


.6? 


f , 


.01 


-.07 


.54 




.OK 


4.01 


.72 




.04 




.63 


4 


.14 


4.0^ 


.64 


f , 


. U 


4 .06 


.6? 


f , 


.IS 


+ .OA 


.50 


♦ , 


,nn 


4 .00 


.6/ 




.n 




.61 


f , 


.OS 




.6-^ 



.64 


+ .01 


-.07 


.69 


0.00 


-.04 


.72 


+ .04 


-.01 


. 7<J 


+ .11 


+ .06 


.71 


+ .04 





.59 


-.03 


-.11 


.74 


4.20 


+ .07 


.77 


+ .05 


+ .03 


.70 


+.07 




. 72 


+ .08 


+ .01 


. 78 


4.16 


+ .08 


.63 


4.13 


-.32 


.75 


4. 10 


4.03 


.7? 


+ .11 




.71 


4.08 
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Table 8A-5 

Grade 2 Average Allocated Hours of Mathematics Skills 
Instruction Per Child Over the Total Study Period 



SCHOOL 



G«ner«l Objactlvt 



I Ob 



Other place Addition 
Writing Incqual- value or *nd Multi- 
Numbers ities numerat ion Sub tract Ion plicat ion 
01 02 03 04 05 
HourH X Hours X Hours % Hours X Hours X 



IGK/DKP 



440 


18. 7 


31 


1.8 


5 


.5 


1 


12.2 


20 


50 3 


14.? 


15 


1.0 


1 


1.8 


2 


39.0 


42 


Mean 


16.5 


21 


1.4 


2 


1.2 


1 


25.6 


33 



IGE/non-DW 



4?8 


3.2 


7 


3.9 


8 


1.5 


3 


22. 2 


47 


1.4 


3 


421 


.3 


1 


.0 


0+ 


9.3 


17 


24.7 


45 


.5 


1 


333 


.3 


1 


.2 


0+ 


1.8 


4 


26.5 


64 


2.3 


6 


Mean 


1.3 


3 


1.4 


3 


4.2 


9 


24.5 


51 


1.4 


3 



non-IOK/UMP 



904 4.8 


10 


3.3 


7 






21.8 


44 






906 in. 2 


11 


5.3 


6 






26.4 


29 






762 5.6 


9 


1.7 


3 


.4 


1 


21.6 


36 2 


.5 


4 


Me.in 6.9 


10 


3.4 


5 


.1 


0+ 


23. 3 


35 


.8 


1 


Grand Mean ?.2 


12 


2.2 


3 


1.9 


3 


24.3 


39 


.8 


1 


NOTE: No allocated 


time 


is indicated 


by - 


less 


than 


.05 hours 


is 




indicated by 


.0. 


0+ indicates 


less 


than 0. 


5X. 









In developing this table, it was necessary to assume that time 
for each objective was allocated equally to all children for 
whom logs were maintained; that Is, if 18 hours were allocated 
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G€nerAX Objective 







Measure- 


Word 


Appli 








Hi9cel 






Fract Ions 


ment 




Problema 


cat Ions 


Geometry 


laneous 




07 




11 




12 




13 




14 




15 




TOTAl, 




X 


Hours 


X 


Hours 


X 


Hours 


% 


Hours 


X 


Houra 


X 


HOURS 


. 7 


1 


3. 1 


5 


15.0 


25 


.2 


0+ 


6.2 


10 


2.8 


5 


60.9 


1.6 


2 


5.? 


6 


16.5 


18 


2.2 


2 






12.2 


13 


93. 7 


1.2 


1 


4.2 


5 


15.8 


20 


1.2 


2 


3.1 


4 


7.5 


10 


77.3 


.5 


1 


2.3 


5 


1.2 


3 






1.6 


3 


9.1 


19 


46.9 


3.8 


7 


3.1 


6 


.7 


1 


.9 


2 


1.9 


3 


9.4 


17 


54.6 


2.3 


6 


1.7 


4 










2.4 


6 


3.7 


9 


41.2 


2,2 


5 


2.4 


5 


.6 


1 


.3 


1 


2.0 


4 


7.4 


16 


47.6 


5. A 


11 


.1 


0+ 


9.6 


19 


.8 


2 


2.1 


4 


1.7 


3 


49.6 


9. 7 


11 






34.5 


38 


3.6 


4 


2.0 


2 






91.7 


8.1 


14 






9.9 


17 


6.6 


11 


6.6 


11 


3.2 


5 


59.8 


7.8 


1? 


.0 


0+ 


18.0 


27 


3.7 


5 


3.6 


5 


1.6 


2 


67.0 


4.0 


6 


1.9 


3 


10.9 


18 


1.8 


3 


2,9 


5 ' 


5.3 


8 


62.3 



(luring one period to addition and subtraction (04), that time 
Would have been recorded as 3 hours per child where logs were 
maintained for 6 children, 2-1/4 hours per child where logs 
were maintained for 8 children, and so on. 
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Table 8A-6 

Mathematics Achievement Results for the Grade 2 Schools 



01--WrUIng Numbers 



02 — Inoqunlltlea 



16<— Place VAluft 
And NumerAtion 



SCHOOL 


1 


8 


Ch an gi.^ 


Resid- 
ual 


1 


8 


Change 


Resid- 
ual 


1 


8 


ICl- /DM!' 


























. 73 


+ .29 


+ .07 


.24 


.57 


+ .33 


-.06 


.44 


.74 






.87 


+ .29 


+ .07 


.40 


.84 


+ .44 


+ .14 


.54 


.86 


Mean 




.83 


+ .29 




.32 


.70 


+ .38 




.49 


.80 


ICK/non-DMP 
























.48 


. 71 


+ .23 


+ .01 


.31 


.60 


+ .29 


-.06 


.45 


.69 




.49 


.71 


+ .22 


-.30 


.43 


. 78 


+ .35 


+ .06 


.48 


.72 


3n 


.6? 


. 11 


+ .15 


-.0? 


. 36 


.79 


+ .43 


+ .10 


.57 


.77 


Mean 


.53 


. 73 


+ .20 




.37 


.72 


+.35 




.50 


.73 


noil - IGK/DMP 
























.M 


. 73 


+ .22 


-.00 


.41 


.72 


+ .31 


+ .01 


.49 


.73 


906 


.62 


.84 


+ .22 


^.00 


.27 


.73 


+ .46 


+ .08 


.55 


.82 


76? 


.4^ 


.60 


+ .15 


-.07 


.41 


.44 


+ .03 


-.27 


.44 


.57 


M*'.»n 


.53 


. 72 


+ . 19 




.36 


.63 


+ .27 




.49 


.71 


Gran.! Mf.m 


.5 J 


. 75 


+ .22 




.35 


.68 


+ .33 




.50 


.74 


St andard 


.0/ 


.08 


















O^vlat icm 






.o: 


.14 






.05 


.09 
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16— Place Value 
and Nume ration 

R«s Id- 
Chan g»? ual 



+ .30 
+ . V 
+ .11 



+ .?R 
+ .?0 
+ .21 



2/ 
1 \ 



04/17--+/- Operat Ions 

Res id - 
1 8 Chang-^ ual 



07/18--Fractlona 

8 Change ual 





















♦ .0/ 


.32 


.44 


+ .12 


-.08 


.34 


.54 


+ .20 


+ .02 


+ .0/ 


.40 


.78 


+ .38 


+ .14 


.51 


.56 


+ .05 


-.00 




.36 


.61 


+ .25 




.42 


.55 


+ .13 




i.Ol 


.32 


.46 


+ .14 


-.06 


.41 


.41 


.00 


-.13 


+ .00 


. 3S 


.53 


+ .18 


-.04 


.59 


.67 


+ .08 


+ .08 


- .06 


.43 


.61 


+ .18 


-.08 


.5? 


.53 


+ .01 


-.04 




.37 


.53 


+ .16 




.51 


.54 


+ .03 


- .00 


.31 


.54 


+ .23 


+ .04 


.30 


.60 


+ .30 


+ .09 


f .01 


. 37 


.63 


+ .26 


+ .03 


.38 


.59 


+ .21 


+ .06 


.10 


.24 




+ .20 


+ .04 


.38 


.43 


+ .05 


-.10 




. 31 


.54 


+ .23 




.35 


.54 


+ .19 






. 34 


.55 


+ .21 




.43 


.54 


+ .09 






.06 


. 12 






.10 


.09 







(Cont Inued) 
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Table 8A-6 (continued) 



I l--Mpauurement 



12--Word Problems 



Re»ld ' 



Resld- 



SCHOOL 


1 


8 


Change 




1 


8 


Change 


ual 




















AAO 


.56 


.57 


+ .01 


-.16 


.26 


.48 


+ .2? 


+ .13 




.56 


. 75 


+ .19 


+ .02 


.A6 


.71 


+ .25 


4.05 




.56 


.66 


+ . 10 




.36 


.60 


+ .24 




It.K/non-DMl* 




















.88 


.97 


+ .09 


+ .15 


.31 


.43 


+ .12 


f .00 


A21 


.25 


.88 


+ .53 


+ .23 


.33 


.48 


+ .15 


+ .02 


^'\\ 


. 70 


.81 


+ .11 


+ .06 


.3A 


.49 


+ .15 


+ .01 




.61 


.89 


+ .28 




.33 


.47 


+ .14 




non-lfJK/UW 


















904 


.11 


.80 


+ .69 


+ .19 


.28 


.33 


+ .05 


-.05 


906 


. ^fl 


.32 


-.06 


-.37 


.32 


.47 


+ .15 


+ .02 




.28 


.51 


+ .25 


-.13 


.33 


.28 


-.05 


-.18 




.26 


. 55 


+ .79 




.31 


.36 


+ .05 




(>r.iiu! Ml-. tit 


.A7 


. 71 


+ .2^ 




.33 


.46 


+ .13 




St.in-i.ir.l 


.26 


..'2 
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Table 8A-7 

Grade 5 Average Allocated Hours of Mathematics Skills 
Instruction per Child Over the Total Study Period, by 
Objective 
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Mathematics Achievement Results for Grade 5 Schools 
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Table 8A-8 (continued) 
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3* IMPLICATIONS ABOUT IGE 
• AND ITS EVALUATION 



In the overview to Part 2, we stated why evidence about 
the effects of planned change is important. A second reason 
for establishing evaluation procedures for a large reform 
project is to share with practitioners and scholars what is 
learned, in this case about ICE and evaluation, and hew that 
knowledge relates to the general literature on schooling and 
change. For example, the recent history of education in the 
Ut)ited States is in large part characterized by massive ef- 
forts, sponsored by foundations or the federal government, to 
engineer and implement changes such as team teaching, pro- 
grammed learning, individualized curriculum programs, modern 
mathematics, modern science, open multigraded schools, and 
$0 forth. But several authors, Coodlad (1976), Bellack 
(1978), and recently Wilcox (1982), have argued that it is 
difficult to find evidence that significant changes have indeed 
occurred in spite of these efforts. Schools seem to be very 
stable institutions which are inherently resistant to such 
changes. Since we observed the same phenomena in this 
project, soma of the things wc learned might be useful to 
others who arc studying why schools rcsi*>t change or how 
one might produce change. 

When this project began, we planned that the members of 
the evaluation team would try to interrelate ideas from each of 
the different phases of the study and discuss them in light of 
specific problems associated with schooling. Unfortunately, 
that did tiot happen. Large projects are embedded in the 
social reality of the times. Interest in ICE and its evaluation 
which had been paramount in 1973 had waned by 1978. 

Thus, we conclude this book about ICE with a single, 
brief chapter. However the staff of the project did attempt 
to convey our findings to n \^ide audience of educators . 
Following chapter 9 is a partial list of presentations and 
papers by staff of the IGE Evaluation Project. 
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A CENTER GOES TO SCHOOL 

Thomas A. Romberg 

IGE AND ITS EVALUATION 

The Center's program of Individually Guided Education is 
a product of the curriculum-school reform of the 1960s. It 
addressed the problem of directing elementary schooling 
toward the individual child. Traditionally, instruction is 
provided to groups, not individuals, with the groups formed 
by age {third graders) or by ability subgroups (slow fifth 
graders). Instruction under these conditions was seen as 
both ineffective and inefficient: ineffective in that the 
particular learning needs of many children were not being 
met, and inefficient in that time and resources were being 
wasted or poorly used. 

In attempting to solve this problem, notions from the 
then current ideology in educational psychology (e.g., 
systems af^alysis, behavioral objectives, learning hierarchies) 
were merged with the intellectual bases of the "new" curricula 
being developed. The contrast between the existing typical 
elementary school and the school of the future was summar- 
ized by Klausmeier, Morrow, and Walter in 1967. (See Table 
9-1.) As the ideas were given form in cooperating classrooms 
and schools, what emer^'ird was a set of procedures schools 
could use and adapt to >r instruction to the needs of 
individual children. T\\v comprehensive program that evolved 
was hailed as "one of the most powerful and flexible sets of 
approaches yet devised for the continuing renewal of educa^ 
tional institutions and the facilitation of teaching and 
learning" (Chase, 1970, p. 2). 

By the 1975-76 school year, nearly 3,000 elementary 
schools in the U.S. were identified with ICE. The ICE 
evaluation project began in May of that year to portray the 
extent of the impact of ICE on elementary schooling. Data 
collection was completed at the end of the 1978-79 school 
year; analysis and reporting of results continued from that 
time. The basic results of the evaluation study were pre- 
sented in chapters 4-8 of this volume and are briefly sum- 
marized here. 
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Table 9-1 

Sum,nary of Functions of an Elementary School 
Today and in the Future 



Functions of the Elemf.ntary School Today 



Functiono of the Elementary School 
In the Decade:^ Ahead 




(1) Attempting to execute a system-wide standard 
Instructional program designed by others 

(2) Accepting sporadic attempts by other 
agencies to update the teaching staff 



(3) Accepting some Innovations recommended by 
others without systematic tasting 



(4) Accepting pre-student teachers, student 
teachers, and Interns without adequate 
provisions for their instruction in the 
school and without adequate supervision 
by college or other personnel 



(1) Developing and executing an effective total 
system of education within each building 

(2) Initiating and performing Inservice educa- 
tion of teachers and other instructional 
personnel within each building as part of 
systematic statewide program 

(3) a. Selecting carefully and testing innova- 

tions prior to acceptance wi:hin each 
building 

b. Developing and testing new procedures and 
materials 

(4) Conducting preservice education of teachers 
and other instructional personnel within 
some buildings as part of a systematic state- 
wide program 



(5) Permitting others to use students and in- (5) 
structional staff as subjects for short- 
term studies that are usually unrelated to 
instructional improvement 



Initiating small-scale development-based re- 
search on instruction and participating with 
other agencies in descriptive research, con- 
trolled experimentation, and comprehensive 
development-based research 



(From Klausmeler, Morrow, & Walter, 1967, p. 2,) 2^3 



!• While responses to an ICE implementation questionnaire 
were received from over 900 schools, in many of those schools 
ICE was never truly adopted. The degree of implementation 
of ICE components was low. Nearly 60% of the sample could 
at best be called "nominal'* adopters of ICE, and only about 
20% could be called true implementers. 

2. The staff and student survey (Phase I) conducted in 
October 1977 in over 150 schools using the ICE label showed 
that the variation in implementation of certain ICE organi- 
zational components had no relationship to variation in student 
achievement in reading and mathematics. However, the 
implementation of ICE components was found to be directly 
related to level of teacher job satisfaction. Participation in a 
larger ICE movement and satisfaction with the effectiveness of 
their instructional program seem to oe the key aspects of 
teachers' job satisfaction. 

3. Phase II, a validation study of the Phase I survey and an 
extension in the area of implementation, substantiated the 
survey results of Phase I for the sample of 30 schools drawn 

' from the Phase I sample. A key finding of Phase II relates 
to variation in ICE implementation among the schools, re- 
flecting differential understanding of the ICE components; the 
more successful ICE schools were those in which the program 
had been installed in a well planned fashion, with prior staff 
commitment and parent approval and provision for sufficient 
training. This phase was conducted in spring 1978 by Re- 
search Triangle Institute under a subcontract with the 
Center. 

Phase III, a case study carried out during the 1977-78 
school year in six schools, focused on institutional life as 
characterized by work, knowledge, and occupational ideol- 
ogies. Three institutional configurations were identified— 
technical, constructive, and illusory. Different assumptions 
about teaching, learning, and schooling in the three types of 
schools determined the form that ICE took in those schools. 
All six schools had been nominated by regional ICE leaders as 
exemplars of ICE schooling. Thus, even in schools reported 
to be exemplary ICE schools, quite different patterns of use 
were observed. 

5. Phase IV was conducted to study the implementation and 
effectiveness of the Center's curriculum programs: DMP, 
WDRSD, and PRS. In the DMP descriptive study, instruc- 
tional time was found to predict student achievement on some 
of the instructional objectives; that finding did not hold for 
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the WDRSD ancj PKS descriptive studies. Interrelationships 
examined in the comparative studies failed to find major 
differences w^^xh could be attributed to either ICE or the 
curriculum pr. jrams. We found that each classroom or Unit 
is unique, with differences in what content is taught and how 
much time is allocated to the content; what operationally 
constitutes an instructional program differs among classes, 
particularly in reading; and ICE and non-iCE schools did not 
systematically differ on content or time variables. 

Both the Center's system of individually Guided Educa- 
tion and the Ford Foundation's Comprehensive School Improve- 
ment Program (CSIP) were begun in the 1960s to "change the 
traditional habits of school systems" (Ford Foundation, 1972, 
p. ^Q). Both used the same R— ^D— (center — ►periph- 
ery) strategy for change. The Ford Foundation approached 
change through the process of teacher development, a "pro- 
fessional" approach based on its research experience of the 
1 950s; the Center's approach was based on research on 
individual student differences and needs. Both saw the need 
for bringing "new ideas and techniques together to achieve 
not just a patchwork of improvement, but a coherent design 
of advancement" (Ford Foundation, 1961, p. 105). The same 
analysis of results can be applied to both programs. 

The limited outcomes . • . strongly suggest that a 
program aspiring to be "comprehensive" ii.ust look 
beyond the manipulation of variables within the 
school, and reckon more directly with outside 
factors such as financing, parent expectations, and 
local social and political pressures. Tiie more 
fundamental the changes conceived, the more cen- 
tral such issues become. [A Foundation Goes to 
School, Ford Foundation, 1972, p. 40) 

WHAT WE LEARNED 
BY GOING TO SCHOOL 

To summarize all that we learned by examining ICE in 
scfools is impossible. Many important findings h-'ve already 
been discussed. Here I would like to emphasize ideas that 
illustrate what we learned about evaluation, about schools and 
reform, about ICE and its implementation, and about the 
r S d center program and federal efforts to change education. 

About Evalu£tion Design 

Gathering data from several different perspectives about 
the s^me program in schools provides a more complete, and 
more complex, picture of how the program is given meaning in 
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schools. The combination of self-report survey data, inter- 
view validation data, field study data, and time-on-task 
observational data provided a more complete picture of ICE in 
practice than any one of the procedures would have by itself. 

Some of the methodological details used in this study 
warrant the attention of other researchers and evaluators. 
For example, the use of causal modeling In Phase I was very 
helpful both in conceptualizing the problem of relationships 
and in testing relationships. The validation-interview pro- 
cedure used in Phase II should be used in similar studies. 
In Phase III, the selection of a sample of exemplary ICE 
schools using a "reputatlonal" survey and the socio-political 
framework for the field study of those schools should be of 
considerable interest. And finally, in Phase IV, the repeated 
measures of primary objectives, tha use of teacher logs and 
extensive observations of pupils and teachers should be 
attended to by other scholars. 

About Measuring Achievement Outcomes 

When designing the study, we recognized that there 
were problems with the measures of student outcomes. Scores 
from standardized tests (adjusted for aptitude) were used as 
outcome variables in Phase 1^ and scores from matrix-sampled 
objective-referenced tests were used in Phase IV. Then 
scores were aggregated to form unit or class means. There 
are both conceptuahvalidity problems and unit-of-analysis 
problems associated with these procedures. 

A standardized test score is not sensitive to variations 
in need and instruction. Similarly, objective-referenced 
tests, while more sensitive to instruction, would only capture 
group growth if there were considerable common instruction 
within groups. The data in Phase IV (see chapter 8) clearly 
show this is not the case. There is not a "common core" of 
instruction in either reading or mathematics. What is clear to 
us now is that scores from norm-referenced and objective- 
referenced tests, no matter how adjusted or aggregated, were 
inadequate. 

The ideal outcome measure would have been an index of 
how well the planned variations in instruction met the needs 
of each individual. Thus, the student would be the unit for 
data collection, and the index would relate student needs, 
instructional intent, and pupil performance. For example', 
one student may need to learn how to group and partition 
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sets. The index would indicate the match between this need, 
the related instructional activities, and how much the student 
learned. 

About Schools and Reform 

The rational procedures which evolved in school settings 
to solve a particular problem were adopted and adapted as 
procedures which could be used to solve other problems. 
Changes in schooling frequently occurred to meet practi- 
tioners' short-term needs, rather than to adopt the com- 
prehensive system of ICE. 

As stated earlier, the primary problem ICE addressed 
was how to shift instructional planning from the group to the 
child. In making such a shift, the key step was identifying 
the intellectual needs of the child; instructional planning was 
to proceed from that point. It was assumed that schools 
agreed with this goal and that practitioners would see the ICE 
procedures as means to be used to reach the goal. 

In most schools that used the ICE label, there was 
neither understanding of nor agreement with this goal. The 
procedures were used for other ends. Very often the label 
was used symbolically to justify the maintenance of current 
practice, as in the nominal or illusory ICE schools. In other 
schools adopting ICE, the goal became to increase efficiency 
of current practices (as in the technical schools), or to have 
a different administrative organization, or to increase stu- 
dents^ sense of community and cooperation (as in /l/D/E/A/ 
ICE schools). However, the procedures of ICE were not 
developed to foster independent-individualized instruction or 
to provide an open learning environment; the multiunit school 
was not devised as a new administrative arrangement to be 
used with conventional instructional goals. It is obvious that 
th^ label ICE school does not have a clear and consistent 
meaning. We now believe the impact of ICE was limited 
because most schools did not identify meeting individual 
student learning needs as their goal and did not see the 
procedures which had been developed as means to that end. 

Further, the grouping and regrouping of students for 
instruction seemed to be the most misunderstood and poorly 
implemented aspect of ICE. The assumption made in ICE was 
that students should be grouped for instruction according to 
need; instruction should proceed for two to three weeks; then 
new groups should be formed. The determination of need was 
to be based on test data, motivation procedures, and profes- 
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sional judgement about Cdv h student. Data particularly from 
Phases II and IV of this siudy show this was not the case. 
The age-graded, self-con t-jned classroom was still the norm; 
grouping was done annually, often on general ability not 
need; motivational p'^c^cedures were not followed; and shared 
decision-making about grouping and regrouping was rare. 
Basic changes in the traditional classroom structure simply 
were not made in most schools. 

There was little evidence of change in instructional 
habits — and where change was made it was inappropriate. As 
stated in chapter 1, content traditionally is segmented and 
sequenced with little possible variation. Students in classes 
compete among themselves on the lessons within each segment; 
evaluation is based on within-group standing; and control is 
maintained through behavior constraints unrelated to instruc- 
tion. The intent of instructional programming in ICE was to 
challenge this set of habits by expecting variations in what 
studeiUs were taught, having students compete against objec- 
tives rather than peers, evaluating students on objective- 
referenced tests, and stressing goal setting and other 
motivational procedures as the basis of group control. In 
most schools, the old habits remained. Changes from the 
traditional practices were evident in some schools, but most 
often behavioral objectives, related testing, and pacing were 
emphasized. What became important was that all students 
master the same set of objectives, and variation in pace was 
assumed. Variations in need, grouping and regrouping, 
motivation, and so on were replaced bv independent-individual 
instruction, a most inefficient instructional procedure. 

The idea thut there is a monolithic American educational 
system is a myth. While there are common traditional charac- 
teristics of schooling that are hard to change, change is seen 
as important. However, the focus of that change is more 
likely to reflect local social and political pressures than grand 
designs for fundamental reforms of the system. Thus, it is 
not surprising that the procedures of ICE were adapted to 
the pathology of the urban environment in the illusory schools, 
or that reading became no more than a set of procedures for 
mastery of objectives in rural and working class schools. 

About IGE and Its Implementation 

The limited positive outcomes of ICE are to some extent 
due to the [)rogram itself. The eclectic basis for the pro- 
cedures meant practitioners could select what t,hey wanted 
from tfie components, and the issues and problems-solving 
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orientation which surrounded the development of ICE were 
lost in the implementation strategy utilized. 



Because ICE was developed in an eclectic manner. It 
lacks a strict ideological structure. The problem being 
addressed dealt with organizing instruction for student 
learning, but there was never adoption of one theory of 
learning. ICE, because of its functional evolution, drew on 
ideas from both the behavioral and constructive psychological 
traditions. Constructivist activities which allow students to 
explore and discover, os in DMP and PRS, are organized via 
task analyses and assessed via tests related to behavioral 
objectives. The management and administrative procedures 
are based on notions from sysi^^ms analysis where knowledge 
to be acquired is fixed, yet instructional procedures remained 
flexible. The original notion of Svudent needs thus was open 
to different interpretations. 

The center — ^out implementation strategy adopted was 
inconsistent witii the problem-solving history from which ICE 
had developed. In the message that was disseminated, the 
issues were lost. The early diss'smination materials empha- 
sized children ("Think Kids"), the contrast between age- 
graded, self-contained classrooms and instruction in I & R 
Units, enthusiasm for innovations and experimentation (the 
original notion of a facilitative environment), and optimism 
about reform ("Away with Tradition"). In later dissemination 
materials the emphasis shifted to procedural rules and per- 
formance objectives^ The learning child was hardly men- 
tioned, discussion of motivational procedures and professional 
judgments was omitted, and facilitation became associated with 
the supportive network of other ICE schools. 

About University-Based R&D Centers 

These centers have a role in educational reform that is 
special in two often contradictory ways. First, because of 
the talent located at major universities and the stable struc- 
ture of faculty tenure, the setting is ideal for carrying out 
long-term research and development. The scholarly interests 
of a particular professor in generating knowledge about a 
phenomenon are not apt to be affected by varying social 
concerns. For example, it is hard to see how research-based 
programs such as Individually Guided Motivation or Develop- 
ing Mathematical Processes could have been produced in 
another setting. 
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Second, as o ronsequence of this role of universities, 
many people overestimate the utility of both the knowledge 
base and the programs produced. As new knowledge is 
generated, the basis of the program is eroded. For example, 
today, as a result of extensive research, our knowledge of 
how students learn has expanded exponentially. Hence, the 
fundamental problem of "student learning needs" today would 
be approached quite differently than it was in the 1960s. 
(See Case 6 Bereiter, 1982, or Romberg & Carpenter, in 
press, for details of this evolution,) Also, school staffs (and 
federal funding agents) fail to see that programs developed to 
produce long-term fundamental changes in school practices are 
of little use in dealing with short-term operational problems. 

About Long-TBrm R&D Efforts 
to Change Education 

It has been 20 years since the federal government estab- 
lished r & d center?; the ICE program, the major product of 
the Wisconsin Center in its initial dozen years, has been held 
up as an example of the impact such centers can have on 
education. 



Long-term research and development activities are diffi- 
cult to carry out in periods of varying social concern. The 
federal r & d center program a:id ICE are products of the 
post-Sputnik curriculum reform era when the intellectual 
growth of students was of prime concern. By the time initial 
elements of ICE were being produced in 1969-71 (the word- 
attack management materials in reading and the multiunit 
school), U.S. involvement in Vietnam, racial unrest, environ- 
mental awareness, and inequality of educational opportunity 
were the concerns. It is not surprising then that schools 
sciw the ICE procedures as techniques to address these social 
concerns. In particular, the /l/D/E/A/ implementation efforts 
for IGE were clearly focused on social concerns. Next, by 
the time iUe WDRSD and DMP programs were completed and an 
extensive set of IGE implementation materials was prepared in 
1 975, there had been a conservative retrenchment. For 
exiimple, in rociction to the controversial elementary social 
studies program Man: A Course of S^'^dy, funds to develop 
and implement curriculum programs were stopped. Thus, just 
at the time a concerted and coherent implementation effort for 
IGE could fiave been mounted, concerns about the role of the 
federal qovornment in school reform were paramount. The 
ICL t}v<iludtion effort wns started in response to ttiis concern, 
tn document tfie impact of ICE on schooling practice. 
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New and difforurU social concerns are regularly drawn to 
the attention of policy mdkers and school staffs. Each con- 
cern reflects a problem and, in most cases, a different con- 
ception of student needs. Federal funding agencies find it 
difficult to allocate resources for long-term efforts. Federal 
support is closely tied to political needs and social pressures. 
Also, in the period of 1963-83, there have been several 
changes in administration and bureaucratic reorganization. 
Each change brought in new people with new interests who 
expected new and different products. And, given that the 
administration may change every four years, results must be 
produced in that period. 



In today^s political discussions, identifying features of 
"effective" schools has gained prominence (Purkey & Smith, 
1983). In one sense, we have come full cycle with concern 
again on student learning; but in another sense, the current 
concern is quite different. Curriculum engineering has given 
way to identifying organizational features and policy actions. 
The notion of "effectiveness" is still very fuzzy. There 
should be open debate over such questions as What consti- 
tutes the knowledge that students should acquire? and How 
does one decide whether that knowledge has been acquired? 
Improved scores on standardized tests are not adequate 
evidence. 

It is important to remember that procedural change 
takes place only at the school level. Policy changes at the 
federal or state level may influence change but are likely to 
result only in ameliorative, nominal, or symbolic changes. 
Change at the operating school level will only happen when 
the problem is identified, staff are committed, and traditions 
openly challenged. Changed outcomes are not enough to 
demonstrate that change has taken place. One must be able 
to see changes in what students and teachers do. 



Be! lack, A. Competing ideologies in research on teaching 
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